IQSS logo

IRC log for #dataverse, 2018-10-26

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
00:29 pdurbin joined #dataverse
06:42 juancorr joined #dataverse
07:29 jri joined #dataverse
10:10 juancorr54 joined #dataverse
10:10 juancorr54 left #dataverse
10:10 juancorr joined #dataverse
11:09 donsizemore joined #dataverse
13:43 poikilotherm joined #dataverse
13:53 donsizemore joined #dataverse
19:56 Jim__ pdurbin?
19:56 pdurbin plop
19:57 Jim__ The DVUploader I've mentioned that I created for TDL is something I/we want to contribute to Dataverse, but I'm not sure where to put it...
19:57 Jim__ It's a separate app
19:58 Jim__ packaged as a java jar file basically, so it doesn't need to be part of the dataverse repo
19:58 Jim__ Any thoughts?
19:59 Jim__ It currently has some code so it can upload to Clowder as well (legacy from the SEAD project) so it could just be a generic uploader on github...
19:59 pdurbin I'd be happy to create a repo for you under IQSS.
20:00 Jim__ I think that works
20:00 pdurbin Then you should make an issue and a pull request to add a link to it from http://guides.dataverse.org/en/4.9.4/user/dataset-management.html#file-handling-and-uploading but you'd need to mention that it's community supported.
20:01 pdurbin We say a lot of things are community supported, Ansible scripts, API client libraries, Docker/Kubernetes configs.
20:01 Jim__ TDL is getting ready to start telling users about it and letting them run it, so I wanted to start getting the code to a long-term home.
20:01 Jim__ Sounds good.
20:02 pdurbin calling it dataverse-something would make sense to me
20:02 pdurbin that's the pattern we're using
20:02 pdurbin for naming these repos
20:02 Jim__ BTW - had fun today realizing that once you upload a file, the dataset can be locked until ingest is done, so you have to wait for the lock to be released and can't just fire way with more uploads (or go parallel...)
20:02 pdurbin or edit metadata
20:02 Jim__ right
20:03 Jim__ glad there's a getLocks api now so you can test
20:03 pdurbin yeah
20:03 pdurbin it would be nice to allow metadata updates at least
20:03 pdurbin I'm cool with locking the dataset so that it can't be delete while a file is being ploaded.
20:04 pdurbin should we call the repo "dataverse-file-uploader"? up to you, really
20:04 Jim__ for a repo - dataverse-uploader? or something more specific?
20:04 pdurbin jinx
20:04 pdurbin does it do more than files?
20:04 pdurbin can you upload metadata with it?
20:04 Jim__ I hope it evolves to be able to read BagiT exports and write a whole dataset + metadata and files...
20:04 Jim__ not yet though
20:04 pdurbin hmm
20:05 pdurbin I'm fine with just dataverse-uploader if that's what makes sense to you.
20:05 Jim__ dataverse-cli seems too broad... cliUploader
20:05 Jim__ good enough for me...
20:06 pdurbin I'll go make it. Can you please go create the issue to tweak the docs?
20:06 Jim__ yep
20:08 pdurbin Ok, I just added you to https://github.com/orgs/IQSS/teams/dataverse-uploader-admin and created https://github.com/IQSS/dataverse-uploader
20:08 pdurbin git remote add origin git@github.com:IQSS/dataverse-uploader.git
20:08 pdurbin git push -u origin master
20:08 pdurbin (since I always forget these)
20:12 pdurbin examples of how we give credit to community supported efforts: http://guides.dataverse.org/en/4.9.4/api/client-libraries.html
20:12 pdurbin we should do more, send you a cake or something
20:14 pdurbin Oh, you could add a link to the repo to this list as well: http://guides.dataverse.org/en/4.9.4/developers/intro.html#related-projects
20:15 pdurbin and here: http://guides.dataverse.org/en/4.9.4/api/apps.html
20:20 Jim__ Thanks!
20:21 Jim__ (got slowed down reading the publish failure issue from today ... saw that the DOIEzid bean was being called even though it was datacite...)
20:22 pdurbin yeah, confusing
20:22 pdurbin the real fix for that issue is to improve our guides, I think
20:23 pdurbin more high level discussion of how to get data in
20:30 pdurbin Jim__: thanks for creating https://github.com/IQSS/dataverse/issues/5240 about the uploader
20:30 pdurbin I'm off. Have a good weekend, everyone!
20:30 pdurbin left #dataverse
20:35 Jim__ Ciao...
21:36 donsizemore joined #dataverse

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.