IQSS logo

IRC log for #dataverse, 2019-07-16

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
03:00 andrewSC joined #dataverse
07:32 poikilotherm joined #dataverse
08:06 j-n-c joined #dataverse
08:28 stefankasberger joined #dataverse
10:48 donsizemore joined #dataverse
11:24 stefankasberger joined #dataverse
12:44 pdurbin poikilotherm: how's your drawing coming along? :)
12:45 pdurbin juancorr: thanks for replying at https://groups.google.com/d/msg/dataverse-community/lkBfsz11dX4/bCvNwEkbCwAJ !
12:46 pdurbin stefankasberger: are you still going to be shelling out to `curl` in the next version of pyDataverse?
12:47 pdurbin pmauduit: I've been clicking "translate" on tweets like this about Dataverse: https://twitter.com/pmauduit/status/1149756031196467200 :)
12:47 stefankasberger yes
12:48 pdurbin stefankasberger: ok, I had to use some crazy "requests" syntax here: https://github.com/IQSS/dataverse-sample-data/blob/c91863d4d924f4997334f7d8f3af6cdb3b46f5a1/create_sample_data.py#L85
12:49 pdurbin I thought maybe I could try to figure out how to remove the calls to curl in pyDataverse, if you want.
12:49 stefankasberger that would be fantastic.
12:49 pdurbin cool, because the "resp" object isn't consistent
12:49 pdurbin it's different when pyDataverse shells out to curl
12:50 stefankasberger mhm, thats true.
12:50 pdurbin so it would be nice to make them consistent
12:51 pdurbin I assume curl would be removed as part of a fix for https://github.com/AUSSDA/pyDataverse/issues/32
12:53 pmauduit pdurbin: ;)
12:53 pmauduit I was just asking if data.gouv.fr (our national opendata portal) was able to harvest a dataverse, as it has the capability to do so on CKAN endpoints
12:57 stefankasberger dont know enough about requests to say that. maybe you can just create an issue as a feature request for the removal of the curl dependency, and then fix it?
12:57 pdurbin pmauduit: can that portal speak OAI-PMH? Is that how it harvests from CKAN? Datavese supports this standard.
12:57 pdurbin stefankasberger: I can try. Maybe not today. :)
13:00 pmauduit no, I think they are using the CKAN api to gather data from ckan, they might also have some CSW harvesting for geographical metadatas stored in geocatalogues
13:00 pdurbin oh
13:00 pmauduit not sure though
13:01 pmauduit I know that data.gouv.fr was previously powered by ckan, but the "state startup" behind it rewrote a tool from scratch as far as I know
13:02 pdurbin interesting
13:04 pmauduit that's the software used now: https://github.com/opendatateam/udata
13:05 pdurbin cool that it's open source
13:08 pdurbin they seem to have a concept of harvesting backends: https://github.com/opendatateam/udata/tree/v1.6.13/udata/harvest/backends
13:21 pmauduit yup
13:30 poikilotherm Oi pdurbin I just found https://www.testcontainers.org/
13:30 poikilotherm (See also https://github.com/testcontainers/testcontainers-java)
13:31 poikilotherm Stumbled over it in an article
14:12 pdurbin_m joined #dataverse
14:12 pdurbin_m poikilotherm: neat!
14:19 pdurbin_m poikilotherm: did you finish your drawing? :)
14:27 poikilotherm pdurbin_m: I didn't do any drawing :-D
14:27 poikilotherm I pulled some strings to resolve https://github.com/IQSS/dataverse-kubernetes/pull/80
14:54 pdurbin no more volume-mount-hack? :)
15:45 donsizemore joined #dataverse
16:17 j-n-c left #dataverse
17:33 donsizemore joined #dataverse
19:20 pdurbin The phoenix server caught another regression before we shipped the next version: https://github.com/IQSS/dataverse/issues/6027
19:20 pdurbin donsizemore: ^^

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.