Time
S
Nick
Message
06:55 juancorr joined #dataverse
07:48 juancorr joined #dataverse
08:17 jri joined #dataverse
09:05 jri joined #dataverse
09:36 pdurbin joined #dataverse
09:52 juancorr joined #dataverse
10:17 juancorr joined #dataverse
10:21 jri joined #dataverse
10:55 jri joined #dataverse
11:33 jri joined #dataverse
11:40 jri joined #dataverse
12:30 donsizemore joined #dataverse
12:47 jri joined #dataverse
12:55 jri joined #dataverse
13:14 drew-jhu joined #dataverse
13:39 drew-jhu
@pdurbin are you available to discuss the reindexing issue (https://github.com/IQSS/dataverse/issues/5575)?
14:01 jri joined #dataverse
15:02 jri joined #dataverse
15:27 donsizemore joined #dataverse
15:31 pdurbin
drew-jhu: hi! yes!
15:42 drew-jhu
hi, pdurbin: welcome back
15:43 drew-jhu
i have a de-identified backup of our database that reliably has the reindexing issue in the same 24 datasets. i can share it with you so you can reproduce and troubleshoot the problem
15:44 drew-jhu
however, since it is a copy of our production data & contains some not-yet public datasets, we have a few requests regarding its use...
15:46 drew-jhu
can you a) limit its use to developer &/or non-public machines b) distribute it securely between those developers who need access to it in order to work on the problem, & c) delete all copies when you are done working on the issue?
15:48 pdurbin
These are good questions to ask support
15:51 drew-jhu
i used two scripts that i'm managing with the ansible playbooks we use to maintain our dataverse: https://github.com/dheles/dataverse-ansible/blob/master/playbooks/queries/deidentify_db.sql.j2 and https://github.com/dheles/dataverse-ansible/blob/master/playbooks/queries/clear_nonessential_data.sql.j2 I added them to the google doc referenced in https://github.com/IQSS/dataverse/issues/4169 , but I don't appear to havve the permissions necess
15:52 drew-jhu
if there were a github repo for such scripts, i'd be happy to PR then into it
15:53 pdurbin
sounds like what donsizemore wants. I forget what were were going to call that repo
15:54 pdurbin
drew-jhu: would it make sense to contribute those scripts to https://github.com/IQSS/dataverse-ansible ?
15:55 pdurbin
I just accepted the addition to the google doc. Thanks!
15:56 drew-jhu
i think that either a dedicated repo or a section of https://github.com/IQSS/dataverse might be more useful. that way non-ansible users would be more likely to find, use & update them
15:56 drew-jhu
they will def require updating as the db structure changes
15:56 pdurbin
drew-jhu: how about adding them to the Admin Guide?
15:57 pdurbin
maybe under http://guides.dataverse.org/en/4.13/admin/backups.html ?
15:59 pdurbin
Or a new page.
15:59 drew-jhu
personally, as a dev, i think i'd find a github repo more useful than embedding them in docs, but that's the community's call. i do note that the issue that led the google doc was created in 2017 and had the (yet-to-be-realized, AFAIK) ambition of putting the queries in the admin guide
16:00 pdurbin
Oh, well, the docs are in the main git repo. Under "docs".
16:00 pdurbin
https://github.com/IQSS/dataverse/blob/v4.13/doc/sphinx-guides/source/admin/backups.rst
16:01 pdurbin
scripts and such would go in https://github.com/IQSS/dataverse/tree/v4.13/doc/sphinx-guides/source/_static/admin
16:02 drew-jhu
i guess i meant a dedicated or bare repo, so that the queries didn't have to be embedded in markup
16:02 pdurbin
They wouldn't have to be. I would make them downloadable. Let me find an example.
16:03 pdurbin
like how "ec2-create-instance.sh" is a link at http://guides.dataverse.org/en/4.13/developers/deployment.html
16:03 jri joined #dataverse
16:03 drew-jhu
at any rate, if you make a place for them, i'll submit mine to go along with the others (that google doc already has lots of them for a variety of purposes)
16:04 pdurbin
You don't like the place I'm suggesting? :)
16:09 drew-jhu
ok, so you would like them to be links added to a "De-identification" subsection of the Backups page of the guide: http://guides.dataverse.org/en/4.13/admin/backups.html - and not in another repo alongside the other queries from the big google doc of useful queries, correct?
16:10 pdurbin
Yes. That's my preference. But I'm happy to create a new repo under IQSS if that's better. What would you call it? dataverse-contrib?
16:12 drew-jhu
that might be useful for containing more then just queries, but IDK. happy to leave that decision to y'all.
16:13 drew-jhu
regarding the issue you'd like created for the handling of the db backup... i'm happy to create it, but i'm not sure i know how.
16:13 drew-jhu
do you mean a github issue, an email to support
16:15 pdurbin
I mean a ticket, which you'd create by emailing support
16:15 pdurbin
(Ideally an issue and a pull request but just a pull request is fine too.)
16:15 drew-jhu
roger. wilco on both
16:16 pdurbin
thank you!
16:16 pdurbin
sorry this is so hard
16:16 drew-jhu
NP. HTH
16:16 pdurbin
Once you have a URL for your ticket please add it in a comment to https://github.com/IQSS/dataverse/issues/5575
16:17 drew-jhu
wilco
16:17 pdurbin
you're making me think of spacequest :)
16:19 drew-jhu
is there a preferred format for the subject line of ticket-creating emails to support
16:19 drew-jhu
idk spacequest, i'm afraid
16:20 pdurbin
it's an old sierra game. I think the first was king's quest.
16:21 pdurbin
no preferred format... maybe something like "database dump to help fix issue 5575"
16:21 drew-jhu
ah. rt. i rem the cover. the guy in the spacesuit brandishing a mop in an action pose. necer played it, so i didn't realize his name was Roger Wilco. (thx, wikipedia)
16:23 pdurbin
put it on your bucket list ;)
16:24 drew-jhu
indeed. those games were always too frustrating for me to actually finish, but def fun for a while
16:25 pdurbin
my brother and I had to buy the hint book. it came with a magic marker to reveal the hidden answers
16:25 pdurbin
it was like 15 bucks
16:28 drew-jhu
pre-internet artifact. could probably auction it off to a collector and get your money back
16:29 pdurbin
heh, I've been trying to marie kondo everything though
17:04 jri joined #dataverse
17:48 donsizemore joined #dataverse
18:11 jri joined #dataverse
18:46 pdurbin
donsizemore: Mike just stopped by to talk about sample data. He appreciated that you added something to the readme. :)
19:11 jri joined #dataverse
19:13 donsizemore
@pdurbin i pecked away at what i could in your absence!
19:14 donsizemore
p.s. have you looked at jamie's server.log yet?
19:14 pdurbin
I was just looking at it.
19:14 donsizemore
<p>Problem accessing /solr/collection1/update. Reason: <pre> Server Error</pre></p><h3>Caused by:</h3><pre>java.lang.NoClassDefFoundError: Could not initialize class sun.nio.fs.UnixCopyFile
19:14 pdurbin
yeah
19:14 pdurbin
seems like solr trouble, generally
19:19 pdurbin
I suggested reinstalling Solr. What do you think it is?
19:25 jri joined #dataverse
19:32 donsizemore
@pdurbin i think reinstalling solr is an excellent suggestion
19:33 pdurbin
:)
19:33 donsizemore
@pdurbin you're committing code to move datasets through the UI!
19:33 donsizemore
@pdurbin you will be Thu-Mai and Mandy's hero
19:34 pdurbin
no, no, thank Paul Boon from DANS
19:34 pdurbin
hmm. ERROR: Permission to PaulBoon/dataverse.git denied to pdurbin.
19:40 pdurbin
donsizemore: I've been saying that a UI to move datasets is going to be a very popular feature.
19:41 pdurbin
I'm very thankful to Paul for implementing it.
20:00 pdurbin
I think I said something like, "This will be a wildly popular feature."
20:12 donsizemore joined #dataverse
21:58 candy`_ joined #dataverse
22:00 pmauduit joined #dataverse
