IQSS logo

IRC log for #dataverse, 2020-05-29

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
07:17 ppeter joined #dataverse
07:22 jri joined #dataverse
07:44 ppeter Hello, I created an issue for Debian support for dataverse-ansible. I broke the changes up to several pull requests, but they are somewhat interdependent (but hopefully none of them creaks CentOS support by themseves -- I know they do not break it together)..
07:44 ppeter So, without further ado: https://github.com/IQSS/dataverse-ansible/issues/178
07:45 ppeter creaks = breaks :)
10:34 jri_ joined #dataverse
10:34 nils`` joined #dataverse
11:41 donsizemore joined #dataverse
11:42 donsizemore @ppeter wonderful! i'll take a look
12:35 nils`` joined #dataverse
12:58 pdurbin awesome
13:03 pdurbin Docker question: https://groups.google.com/d/msg/dataverse-community/xVu90J2-goc/jUJ0FAYMAQAJ I'm at a loss. poikilotherm donsizemore any thoughts?
13:03 poikilotherm Sounds like an index issue
13:04 poikilotherm But sounds like fun to debug
13:04 poikilotherm (Not)
13:05 nils`` joined #dataverse
13:07 donsizemore @pdurbin same
13:08 pdurbin But what's weird is that MyData is also powered by the index.
13:09 donsizemore @purbin i'm assuming solr is in a separate container, and that it isn't getting rebuilt?
13:13 pdurbin Hmm. Maybe.
13:13 pdurbin But why would looking at a dataset reindex it?
13:13 pdurbin Very strange.
13:17 poikilotherm I'm really sorry not to have the capacity to  reproduce right now... :-(
13:18 donsizemore @pdurbin what sort of front-page cache does glassfish maintain?
13:19 donsizemore @pdurbin the first page load after launch takes a ton of CPU so its generating it somewhere
13:19 pdurbin Well, Java takes a while to warm up. I assume that's what you're seeing.
13:19 pdurbin We don't use anything like Varnish as a cache.
13:19 donsizemore no... i wait for glassfish itself to calm down, then i load the homepage, and that takes another huge burst of CPU
13:20 donsizemore after that the initial page load seems cached and displays quickly
13:25 poikilotherm donsizemore: things like EL expressions are precomputed where necessary etc.
13:25 poikilotherm That is all stored in memory
13:26 donsizemore but anything to do with homepage display?
13:26 poikilotherm Yeah. JSF :-)
13:26 poikilotherm EL expressions are used in JSF for computiation within the views
13:27 poikilotherm And I'm not sure when things like locales are loaded and parsed
13:27 poikilotherm All of this stuff can be profiled :-D
13:27 pdurbin Right, but loading the homepages triggers a bunch of Java, a burst of CPU, like you said, but then the JVM is warmed up for tha page to the next homepage load is probably faster.
13:28 poikilotherm Yeah, that's what I meant
13:28 donsizemore @pdurbin does he nuke osgi-cache and generated/ before starting?
13:28 pdurbin who? the docker guy?
13:28 donsizemore yes
13:28 donsizemore Matthew says "definitely could be a solr configuration issue"
13:28 pdurbin no idea
13:30 pdurbin donsizemore: for the perf thing, you are welcome to open an issue. How many milliseconds does it take? How many milliseconds are reasonable?
13:30 donsizemore dunno, i can time it if you like
13:31 pdurbin Really we should time it in Jenkins. :)
13:31 donsizemore but with Drupal, Jenkins, Dataverse... the first page load always takes longer
13:31 poikilotherm https://dzone.com/articles/tuning-and-configuring-java-server-facesjsf-web-ap
13:31 poikilotherm Lots of stuff in Dataverse is pretty static and can be pre-rendered
13:31 poikilotherm He. Maybe then you should do a profiling :-D
13:34 pdurbin Oh, sorry, I meant we should measure performance of Dataverse from Jenkins.
13:34 donsizemore hasn't been a priority for me
13:34 pdurbin Get a nice trend line going and see if Dataverse is getting faster or slower over time.
13:35 donsizemore silly little test, 4.16 on glassfish4: 1st load 0m5.337s 2nd 0m1.706s
13:36 donsizemore but anyway, my suggestion to alexandre would be to be sure he's nuking osgi-cache/ and generated/ before launching glassfish/payara
13:37 donsizemore speaking of @poikilotherm and @pdurbin were your ears burning a bit ago?
13:38 poikilotherm Hmm?
13:40 donsizemore @poikilotherm for the DCM testing and deployment session. short presentation but primarily a discussion. hope you can attend. your work on dataverse-k8s, dv-cli and hopes for payara microprofile are potential discussion topics
13:40 donsizemore @pdurbin I mentioned your finding the length of the package-test-deploy cycle irksome
13:41 donsizemore Slava wants badged levels of quality assurance, I'm hoping Pete and Stefan will attend. and now we have PRs for Dataverse on Debian 10
13:48 nils`` joined #dataverse
14:20 nils`` joined #dataverse
14:21 pdurbin definitely looking forward to it
14:32 donsizemore @pdurbin did you see my slack?
14:45 pdurbin now I do
14:47 poikilotherm OK guys, I'm done for today
14:48 poikilotherm I'm really looking forward to the session
14:48 poikilotherm If you want me to do any kind of presentation, please send me a note. I can talk about so much things...
14:49 poikilotherm Hard to focus currently
14:49 pdurbin build that house!
14:53 poikilotherm My development for mail domain groups grew a bit today :-D I wanted to make you happy pdurbin by adding unit tests for 90% of the code... :-)
14:54 pdurbin so happy
14:59 poikilotherm :-P
14:59 * poikilotherm waves at everyone
15:00 poikilotherm I'm just a mention away on my mobile :-)
15:08 nils`` joined #dataverse
15:25 dataverse-user joined #dataverse
15:26 dataverse-user Hello guys, I hope you're doing great ... is there any OAI-PMH interface on dataverse?
15:28 pdurbin dataverse-user: hi, yes, we call it "harvesting"
15:29 pdurbin http://guides.dataverse.org/en/4.20/admin/harvestserver.html
15:33 dataverse-user Ok great, i've created a dataset to recolect
15:33 dataverse-user but on the documentation i don't see what base url i should use for OAI harvesting
15:38 pdurbin Huh. I thought we added that.
15:38 pdurbin "The OAI-PMH endpoint can be accessed at http(s)://<Your Dataverse FQDN>/oai"
15:39 pdurbin so https://dataverse.harvard.edu/oai for example
15:42 dataverse-user thanks ... now i'm getting this error
15:42 dataverse-user <error code="badVerb">Illegal verb</error>
15:42 pdurbin yeah, you have to give it a verb
15:42 pdurbin for example: https://dataverse.harvard.edu/oai?verb=Identify
15:43 dataverse-user and the verb could be the name
15:43 dataverse-user of the OAI setSpec?
15:44 pdurbin you can do https://dataverse.harvard.edu/oai?verb=ListSets
15:48 dataverse-user Thank you!
15:48 pdurbin sure :)
15:55 jri joined #dataverse
15:57 jri_ joined #dataverse
16:32 jri joined #dataverse
17:07 jri joined #dataverse
17:09 donsizemore joined #dataverse
17:44 jri joined #dataverse
18:48 nils`` joined #dataverse
19:53 jri joined #dataverse
20:17 jri joined #dataverse
21:01 pdurbin ok, folks, I'm taking off, have a great weekend!
21:01 pdurbin left #dataverse

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.