IQSS logo

IRC log for #dataverse, 2017-06-29

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
00:02 axfelix joined #dataverse
01:01 axfelix joined #dataverse
01:11 jri joined #dataverse
02:44 axfelix joined #dataverse
04:02 axfelix joined #dataverse
04:11 jri joined #dataverse
04:13 axfelix joined #dataverse
04:21 axfelix joined #dataverse
04:22 axfelix joined #dataverse
05:19 axfelix joined #dataverse
06:39 axfelix joined #dataverse
07:09 axfelix joined #dataverse
07:11 jri joined #dataverse
07:24 moayadnajd joined #dataverse
07:25 moayadnajd hi
07:25 moayadnajd is there a docker image for the new version of dataverse
07:25 moayadnajd ?
08:06 moayadnajd joined #dataverse
08:34 jri joined #dataverse
08:40 jri joined #dataverse
08:46 pdurbin_m joined #dataverse
08:47 pdurbin_m shoot, missed them. see https://github.com/IQSS/dataverse/issues/3938
10:05 jri joined #dataverse
10:40 jri joined #dataverse
11:11 donsizemore joined #dataverse
11:13 jri joined #dataverse
11:37 pdurbin donsizemore: mornin! No good deed will go unpunished. I just left you a comment: Glassfish is installed and run as root · Issue #1934 · IQSS/dataverse - https://github.com/IQSS/dataverse/issues/1934#issuecomment-311940705 :)
11:38 donsizemore @pdurbin morning! i have a fork of craig's stuff, pulled the iRODS bits out, and just getting things current and buildable by particular branch
11:39 donsizemore @pdurbin during the developers' workshop i remember your saying "as long as it works" so no making fun of my crappy code ;)
11:40 donsizemore @pdurbin i've got to rewrite the dataverse container build stuff; craig smartly broke out the database schema creation among other things
11:41 jri joined #dataverse
11:48 pdurbin Yes. As long as it works. Here's a picture of that hackathon: https://dataverse.org/blog/forging-connections-dcm-2017 :)
11:50 jri joined #dataverse
12:16 jri joined #dataverse
14:05 donsizemore joined #dataverse
14:31 donsizemore joined #dataverse
14:51 jri joined #dataverse
14:58 jri joined #dataverse
15:03 donsizemore @pdurbin so, if dataverse 4.7 can't seem to do much with solr through the API....
15:05 donsizemore @pdurbin p.s. when is Harvard going to bump to 4.7?
15:09 jhand joined #dataverse
15:24 jri joined #dataverse
16:05 jri joined #dataverse
17:26 donsizemore joined #dataverse
18:15 bjonnh joined #dataverse
18:21 bjonnh joined #dataverse
19:53 pdurbin donsizemore: done! bumped!
20:44 donsizemore @pdurbin i'm curious to see if you run into anything with... solr.
20:47 pdurbin demo site too
20:48 pdurbin donsizemore: sorry, I'm confused. What do I need to fix with regard to Solr?
20:49 donsizemore @pdurbin i'm not sure yet. i'm just curious if you all run into problems with solr under 4.7
20:51 pdurbin Nope. Like I'm saying https://dataverse.harvard.edu was upgraded to Dataverse 4.7 today and it seems to work fine with Solr.
20:52 donsizemore @pdurbin short story: i've upgraded three test servers to 4.7 as of monday, and ran into problems re-indexing (to keep the D in Dataverse)
20:52 pdurbin anything odd in server.log?
20:53 donsizemore @pdurbin at some point, Dataverse stops responding to solr API calls, nothing in server.log, i've enabled access_log and am trying to replicate it. solr responds for homepages and searches, but trying any of the API calls in the Dataverse/Solr guide results in nothing logged by Dataverse, and a timeout to curl.
20:55 donsizemore @pdurbin it's only happening on this test server, but that's our only test server with any amount of data on it. trying to pin down something more helpful (or find what i did wrong). solr removes its write_lock when i stop it, i've tried moving the index/ directory aside, but the hold-up seems to be within Dataverse/Glassfish
20:58 pdurbin donsizemore: how would I reproduce? What are the steps?
20:59 donsizemore @pdurbin leave a server with some amount of indexed data running for a day or two (or over the holiday weekend, which i hope you enjoy very much, BTW)
21:00 pdurbin and then what. what do you observe/
21:00 pdurbin ?
21:00 pdurbin searching stops working?
21:00 donsizemore @pdurbin then come back in the morning and try to curl http://localhost:8080/api/admin/index/clear (or maybe publish something, which i'll try the next time it does this)
21:01 donsizemore @pdurbin searching works, facets work, homepage works. but any manipulation of solr through the Dataverse API results in a timeout
21:01 pdurbin so you can read from Solr but you can't write to it
21:01 donsizemore @pdurbin i've got two other servers running 4.7 that are fine, but they've got like 10 test datasets. this one has an import of our production data
21:02 donsizemore @pdurbin yes, sorry i should've said that in the first place
21:07 pdurbin And the only change was upgrading Dataverse? Very strange.
21:07 pdurbin works on my machine :)
21:07 donsizemore @pdurbin agreed. as usual, i blame me, i'm just not sure how
21:13 pdurbin hmm
21:13 pdurbin I got nuthin.
21:14 pdurbin donsizemore: I'm on the solr mailing list if you want to try them. The creator of Solr helped me out back in the day, when Solr 4.6.1 was new. :)
21:24 donsizemore @pdurbin i did see some stuff at the end of the last re-index, if i might forward it to you?
21:27 pdurbin donsizemore: sure, can you please send it to support@dataverse.org ?
21:34 donsizemore @pdurbin let me catch it in that state again, and I will.
21:34 pdurbin cool, thanks
21:35 donsizemore @pdurbin: re #1934 - the database creation is the only thing that _needs_ to run as root, aside from the install script copying the jdbc jar into glassfish/lib
21:35 pdurbin don't the docs say you don't need to run it as root? is it a lie?
21:36 donsizemore @pdurbin the script just needs postgres admin credentials (possibly safer to allow the end user to create the DB, hence the suggestion of an SQL scriptlet), and the installer just needs to be able to write to certain glassfish directories (for jdbc driver, and anything beneath domain1/)
21:37 pdurbin hmm
21:39 donsizemore @pdurbin so really, the script could just test for and/or create a glassfish service account, and the issue would be addressed. but nicer to do the whole thing as the service account (as little rootage as possible)
21:39 pdurbin yeah
21:39 pdurbin down with rootage
21:40 donsizemore (which means less work for the installer, more to do with the docs, but seems cleaner all around)
22:22 bjonnh joined #dataverse
22:45 axfelix joined #dataverse
23:59 donsizemore joined #dataverse

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.