IQSS logo

IRC log for #dataverse, 2019-02-14

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
07:53 jri joined #dataverse
08:35 jri joined #dataverse
08:45 MrK joined #dataverse
10:34 jri joined #dataverse
10:36 jri joined #dataverse
12:22 pdurbin MrK: hi! Looks like you pushed some commits to your Flyway pull request.
13:32 donsizemore joined #dataverse
13:54 pdurbin donsizemore: mornin. Thanks again for working on the sample data stuff.
13:57 donsizemore @pdurbin once I iron out our new backup server I'll be back on that. I pushed what I had so far, I think you were just missing a group_var to test?
14:11 MrK pdurbin: hi, yeah I also had some discussion with coworker about aproach so I've changed some coded and pushed some comments :P
14:28 pdurbin MrK: ok. Are you ready for more code review?
14:29 donsizemore @pdurbin yis yis i'm dying importing sample dataverses
14:29 MrK pdurbin: Yeah
14:30 pdurbin MrK: thanks. I dragged it over.
14:31 pdurbin donsizemore: maybe? I was getthing this: 'dict object' has no attribute 'sampledataverses'
14:31 pdurbin How can I help with importing sample dataverses? Should work. There's an API for it.
14:32 donsizemore @pdurbin i'm calling that API... just looking back into it now
14:32 donsizemore i just merged with master if you want to do a pull on the branch
14:33 donsizemore i suspect the ansible uri module rather than dataverse
14:34 pdurbin I don't see sampledata in master. Only in 37_sample_data.
14:36 donsizemore so, the sample dataverse data i pulled only has contactEmail, but the API example uses dataverseContacts
14:36 jri joined #dataverse
14:36 donsizemore is it possible your sample data (i'm using chestnut) fell behind?
14:37 pdurbin Sorry, let's back up please. Are you sure I should be using master?
14:37 donsizemore no you want 37
14:37 pdurbin ok
14:37 donsizemore i pull recent commits into 37 from master
14:38 pdurbin ok. let me give it another try
14:42 pdurbin ok, I kicked it off. thanks!
14:43 donsizemore i get a 400 error creating sample dataverses and it crabs about line 64... so i suspect the uri module
14:44 pdurbin uri module?
14:49 pdurbin Hmm, I probably should have just gone for a release instead of develop because now I'm waiting for the war file to compile. :) Oh well. Next time.
14:52 pdurbin donsizemore: something about HTTP Error 400: Bad Request and Error parsing Json for 01_spruce.
15:00 pdurbin I put the output at https://github.com/IQSS/dataverse-ansible/issues/37#issuecomment-463658287
15:03 donsizemore joined #dataverse
15:13 donsizemore @pdurbin woo woo! now i get "Root Dataverse already exists. Cannot create another one"
15:21 pdurbin heh
15:23 pdurbin donsizemore: /tmp/create-users.sh seems to want to operate on /home/centos/dataverse/sampledata/users but that directory doesn't exist for me.
15:26 pdurbin Scratch that. Yes, it does. But no users were created.
15:31 pameyer joined #dataverse
15:33 pdurbin {"status":"ERROR","message":"Dataverse config issue: No API key defined for built in user management"}
15:33 pdurbin well, that explains it
15:35 pdurbin donsizemore: do you know about this? The "burrito" thing?
15:36 donsizemore the sekret key?
15:36 pdurbin yeah. http://guides.dataverse.org/en/4.10.1/developers/testing.html#the-burrito-key
15:36 pdurbin Can I define it in main.yml?
15:38 donsizemore @pdurbin i'm pulling the API key in ansible. on paths... i'm testing in vagrant, so i can stick in a switch to check for that
15:39 pdurbin Ok. The other way to fix this is to allow us to pass the "--insecure" flag: https://github.com/IQSS/dataverse/blob/v4.10.1/scripts/api/setup-all.sh#L9
15:47 donsizemore woo woo, it created the sample dataverses!
15:47 pdurbin nice
15:48 donsizemore remind me what i need to do to enable publishing-without-publishing? it's not on the dev troubleshooting page
15:49 pdurbin provider: FAKE
15:49 pdurbin Is that what you mean?
15:50 pdurbin curl http://localhost:8080/api/admin/settings/:DoiProvider -X PUT -d FAKE
15:50 pdurbin http://guides.dataverse.org/en/4.10.1/developers/dev-environment.html#configure-your-development-environment-for-publishing
15:50 donsizemore going to pop that in as well to refresh the web interface
15:51 pdurbin sounds like you were able to create datasets too :)
15:52 donsizemore @pdurbin well, the sample dataverses are in the database but aren't showing up in the web interface and reindexing isn't doing the trick
15:53 donsizemore i'm starting with switching the vagrant doi provider to FAKE then will troubleshoot further
15:53 pdurbin Weird. I assume there are indexing errors in server.log.
16:04 donsizemore yeah, from datacite. i have the FAKE provider in place tho.
16:06 pdurbin When I manually create a dataverse, it is successfully indexed.
16:11 donsizemore same. and i can publish it.
16:12 pdurbin Cool. Lemme know when you push so I can try the sample data stuff again.
16:12 donsizemore i just pushed what i had. if you're getting path errors outside of vagrant just try vagrant for now?
16:12 donsizemore also: unable to index dataverse. id was null (alias: wrens)
16:13 pdurbin huh, weird
16:13 donsizemore i think it's because the root dataverse affiliation is blank?
16:14 donsizemore between dvobject and dataverse tables that's the only thing i see blank
16:15 pdurbin In your latest commit I don't see how you're adding a burrito key or whatever.
16:15 pdurbin Don't we still need that?
16:16 donsizemore i'm calling read_API_token.sh and setting the output as a fact
16:35 dataverse-user joined #dataverse
16:43 pdurbin donsizemore: I just tested 355d3f7 and no users were created. No users apart from dataverseAdmin, I mean. read_API_token.sh is fine for getting the dataverseAdmin API token but who is creating all the dataverses? dataverseAdmin? With my birds and trees scripts, users like "finch" and "spruce" create the datasets etc.
16:44 donsizemore @pdurbin i've only done the dataverses. this has been a back-burner thing; i'm digging into why i'm getting errors from datacite with the FAKE provider specified
16:46 pdurbin Ok. No problem. And no rush! But heads up that I'm getting CreateDataverseCommand failures and only have one dataverse, the root dataverse.
16:47 pdurbin anyway, I'm heading to a talk about https://github.com/SwissDataScienceCenter/renku
17:10 jri joined #dataverse
17:22 donsizemore @pdurbin woo woo, sample dataverses. now on to datasets, users and permissions.
18:41 pdurbin donsizemore: great!
19:06 donsizemore joined #dataverse
19:22 donsizemore @pdurbin knock knock?
19:35 donsizemore joined #dataverse
20:06 pdurbin donsizemore: it's TRSA demo time! :)
20:07 donsizemore @pdurbin i've got the dataverse and user bit working, but i see you're manually creating combos of datasets by user by api (native/sword)
20:07 donsizemore and so far i'm assuming a) if the sampledata pre-exists, the user has populated it. if not, create one and fill it with sample sampledata
20:09 donsizemore and so far i'm leaning toward checking for a script which would create datasets with the sample sampledata. unless the user supplies a better one? thinking through which mechanism might work best
20:10 pdurbin donsizemore pameyer if you want to help with notes: 2019-02-14 TRSA Meeting Notes https://docs.google.com/document/d/1nC51spDouREHrg7jHUojBw7sB7jJ82CYVHpw9gR7KDU/edit?usp=sharing
20:30 pdurbin donsizemore: do you have a link to the "presidio" code?
20:35 donsizemore @pdurbin Victor wants to clean it up before he publishes =) it will appear in the "impact" repo I linked
20:39 pdurbin ok, under "The major architectural elements include:" ... thanks
20:41 donsizemore @pdurbin the current plan is to run it in Docker over a CIFS mount
20:58 pameyer @donsizemore - you saw the container escape cve, right?
20:59 pameyer @donsizmore - interesting demo
21:03 pdurbin yeah, great demo
21:05 jri joined #dataverse
21:21 pdurbin ooo, something new to play with... usermgmtkey: burrito
22:15 donsizemore joined #dataverse

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.