Time
S
Nick
Message
06:37 andrewSC joined #dataverse
06:51 poikilotherm joined #dataverse
09:12 stefankasberger joined #dataverse
09:14 juancorr joined #dataverse
09:30 stefankasberger
I have started to create some templates to use data for the Dataverse API . First, I pre-defined some CSV files for later JSON conversion. You can find them here: https://github.com/AUSSDA/pyDataverse_templates
09:44 rowan joined #dataverse
09:45 pdurbin
stefankasberger: seems cool but I'm a little confused. Would you be able to give me an example CSV file with this dataverse in it? https://github.com/IQSS/dataverse-sample-data/blob/efda97a41af2d2b521c75d9c04e4a6a36da540b0/data/dataverses/open-source-at-harvard/open-source-at-harvard.json
09:45 pdurbin
rowwilox: welcome
09:46 pdurbin
xarthisius: https://github.com/jupyter/repo2docker/pull/739 was merged! Thank you!!
09:50 pdurbin
poikilotherm: nice tweet! https://twitter.com/poi_ki_lo_therm/status/1174230258079477765
09:51 pdurbin
And all the work behind the tweet, of course. :)
09:55 poikilotherm
Good morning pdurbin :-)
09:56 poikilotherm
I do have the impression you get up earlier every day just to relax timezone complications :-D
09:57 pdurbin
It's still dark here.
10:20 kiru joined #dataverse
10:26 poikilotherm
pdurbin: how is the discussion about moving to Payara 5 going at IQSS?
10:34 pdurbin
I'm like a broken record about it.
10:34 pdurbin
Can we see if the API test suite passes on Payara 5?
10:34 pdurbin
pkiraly: hi! Thanks for the pull request!
10:36 pdurbin
Oh, in case you Europeans missed it: https://site.uit.no/dataverseno/european-dataverse-workshop-2020/ ... juancorr pkiraly pmauduit poikilotherm stefankasberger
10:36 poikilotherm
Saw that on Twitter :-)
10:37 poikilotherm
I don't think I can make it... Going to Lissabon the week after
10:37 poikilotherm
Looking forward to meet you there!
10:37 pdurbin
Yeah, Danny told me to get a nicer hotel. Where are you staying?
10:37 poikilotherm
I haven't looked yet
10:38 pdurbin
Did everybody see this on Twitter? https://twitter.com/java/status/1173756452416233472
10:38 poikilotherm
Friends of my parents are visiting Lisabon regularly, I was going to ask them for a recommendation
10:39 poikilotherm
I noticed some going from @dataverseorg got this, but the name was unfamiliar
10:39 pdurbin
Maybe you saw this? https://twitter.com/michbarsinai/status/1173847581224574976
10:40 poikilotherm
I swa this https://twitter.com/GeertjanW/status/1173736642017972224
10:40 poikilotherm
That's linked from the above
10:40 pdurbin
yeah
10:40 pdurbin
Here's the blog post: https://blogs.oracle.com/java/2019-dukes-choice-award-winners
10:41 pdurbin
Hopefully Payara is being talked about at the conference.
10:43 pkiraly
Hi, when I try searching in Dataverse doc, I get a warning, and the search is not working.
10:43 pkiraly
http://guides.dataverse.org/en/4.16/search.html?q=reExportAll
10:43 pkiraly
the warning: "Please activate JavaScript to enable the search functionality."
10:43 pkiraly
It happens in Firefox and in Chrome under Ubuntu 18.04
10:44 pdurbin
pkiraly: yes, can you please leave a comment at https://github.com/IQSS/dataverse/issues/6151 ?
10:47 poikilotherm
Hi @pkiraly :-)
10:47 pkiraly
Hi @poikilotherm!
10:48 poikilotherm
pdurbin: good to know you keep to tell people what should be done :-D
10:48 poikilotherm
I am about to write you guys an interesting email... ;-)
10:48 poikilotherm
I hope Danny is around...
10:59 pdurbin
poikilotherm: he just got back from a long vacation in Italy
11:00 poikilotherm
Oh nice :-)
11:00 poikilotherm
He could have done a detour to Jülich then...
11:01 poikilotherm
From Italy to Jülich is a lot easier than from Harvard to Jülich ;-)
11:02 pdurbin
I forgot to tell him about this bucket I heard about, still on display: https://en.wikipedia.org/wiki/War_of_the_Bucket
11:06 poikilotherm
:-D
11:06 poikilotherm
I didn't knew that either
11:19 pkiraly
@pdurbin, How can I help in https://github.com/IQSS/dataverse/issues/6083? Sorry, for me it is not evident.
11:19 pdurbin
pkiraly: here's an example: https://github.com/OdumInstitute/dataverse/commit/81928957d4a9cb2212da2ff4ccd498764fecd492
11:20 pdurbin
The idea is to switch to full curl commands.
11:20 pdurbin
Does that make sense?
11:22 pdurbin
However, that commit is not a perfect example because I'd like to standadize on using "export" commands like in http://guides.dataverse.org/en/4.16/api/getting-started.html#curl-examples-and-environment-variables
11:22 pkiraly
so shortly, from curl $SERVER_URL/api/search?q=$QUERY to curl https://demo.dataverse.org/api/search?q=data ?
11:22 pdurbin
Well...
11:22 pkiraly
the other way around?
11:23 pdurbin
Well, sometimes I document it twice... once with environment variables and a second time with a concrete example. Please see http://guides.dataverse.org/en/4.16/api/native-api.html#publish-dataverse-api
11:24 pdurbin
I call the second form with the concrete example "fully expanded".
11:24 pdurbin
Does that make sense? Do you like how that "Publish a Dataverse" API endpoint is documented? I'm eager for feedback.
11:26 pkiraly
I like the fully expanded version. I guess there are two use cases. One is when you would like to pick one or two API commands and run it. The other when you work with API in a longer session.
11:28 pkiraly
I came to this issue when I updated Dataverse to 4.16, and there were an API call requested. In this case I do not have environmental variable set, I just want to run a quick command, then moving to the next item of the version update.
11:29 pkiraly
So in this situation explicit curl command is the preferred way.
11:29 pkiraly
("explicit curl command" and "fully expanded" is the same)
11:33 pdurbin
Right. In some cases, no environment variable are necessary. Such as `curl http://localhost:8080/api/admin/metadata/exportAll `. So we don't need "import" there. We can keep it simple.
11:35 pdurbin
pkiraly: maybe it would be best for you to make a small pull request where you improve the documentation for just a single API endpoint. Then I can give you feedback on it.
11:35 pkiraly
So the task is to go over the documentation, finding all "GET" "PUT" etc., and either replace it with "fully expanded" curl command or adding both "curl with exports" and "fully expanded curl"
11:35 pkiraly
one by one of course
11:37 donsizemore joined #dataverse
11:39 pdurbin
Yes, let's start with one, please. :)
11:40 donsizemore
morning @pdurbin i'm hoping to fix ansible #102 and #103 before my meetings start at 10
11:40 donsizemore
@pdurbin i'm afraid i won't have much to report at 3pm but we've got some upstream stuff to review
11:41 pdurbin
donsizemore: Gustavo is in SF ( https://twitter.com/java/status/1173756452416233472 ) so do you want to cancel? We can just talk here?
11:41 donsizemore
fine by me
11:42 donsizemore
@pdurbin who's the Duke? also, i'm insanely jealous he's in SF in September
11:42 donsizemore
october is maybe my favorite month to visit
11:44 pdurbin
https://www.oracle.com/java/duke.html
11:47 * donsizemore
wonders if James and Washington know about this
11:47 pdurbin
donsizemore: https://github.com/IQSS/dataverse-ansible/issues/102 is due to the Solr changed poikilotherm made recently and I'd like to discuss Leonid's branch before merging. I'm hoping we can add some conditional logic about if we're on "develop" or "release".
11:47 pdurbin
changes*
11:48 donsizemore
@pdurbin i was just about to create a branch
11:48 donsizemore
@pdurbin i can do that but i don't have much spare time today
11:48 pdurbin
donsizemore: sure, if you want to create a new branch, that's fine. Leonid's branch can at least show you what needs to happen.
11:49 donsizemore
we've got the last of the interviews for andrey's position and i got whomped with infrastructure stuff
11:49 pdurbin
And poikilotherm can explain if you have any questions. I've been skipping the gym but I think I'll go today. I'm glad interviews are happening!
11:50 donsizemore
i'll just add the conditions in the solr task and pull what leonid has in his branch for now. can always update it later
11:50 poikilotherm
Sure, I'll be around for about 4h, so lots of time to ask questions :-D
11:58 poikilotherm
Whoops. 3h, not 4.
12:02 donsizemore
i'm just going to doctor up what leonid already pushed and run with it
12:04 donsizemore
@poikilotherm it all looks pretty straightforward, thanks!
12:05 donsizemore
@poikilotherm we have a sizeable metadata block here describing all types of love, so a more flexible solr schema is much appreciated
12:05 poikilotherm
:-D
12:06 poikilotherm
donsizemore: I was wondering why landreev is using the shell exec
12:06 donsizemore
just gonna make it a copy
12:07 poikilotherm
And use with_fileglib?
12:07 donsizemore
nods
12:07 poikilotherm
s/i/o /
12:07 poikilotherm
nice
12:13 donsizemore
(i'm also playing tabs/spaces)
12:23 poikilotherm
Heads up pdurbin: https://dans.dataverse.tk/ is running on AWS using dataverse-kubernetes
12:24 poikilotherm
And they have the file previewer enabled
12:32 pkiraly
Is it possible to select a particular commit for a pull request?
12:33 pkiraly
The github UI doesn't seem provide this option. The request contains everything which is in the branch.
12:37 poikilotherm
pkiraly: by "select" you mean copy a URL ?
12:38 poikilotherm
E. g. https://github.com/IQSS/dataverse-kubernetes/pull/87#discussion_r325580311
12:39 pkiraly
I've already created a pull request with a commit. If I add a new commit, and create a new pull request it will contain two commits. I want the pull request to be independent, and each should contain only the latest commit.
12:41 pkiraly
maybe I should create a new branch for every new commits of this kind.
13:10 pdurbin
pkiraly: sure, a new branch is fine. You should always branch from the latest in the "develop" branch, please. But we'll merge pull requests even if you don't. :)
13:11 pdurbin
poikilotherm: .tk is for Tokelau?
13:13 pdurbin
donsizemore: I'm hoping to finally spin up https://github.com/IQSS/dataverse-jenkins/pull/16 today
13:25 poikilotherm
pdurbin: I have no idea :-D
13:26 poikilotherm
Saw this too late, could have asked him in VC ;-)
13:26 pdurbin
It would be nice if he joined us here. :)
13:27 pdurbin
pkiraly: thanks for joining here. :)
13:29 pdurbin
poikilotherm: what's the status of https://github.com/IQSS/dataverse-kubernetes/issues/63 ?
13:29 poikilotherm
Working on it :-D
13:29 pdurbin
great!
13:29 poikilotherm
Merging the dev stuff is a blocker for that
13:29 poikilotherm
(#64)
13:34 pdurbin
Should we just merge it? I haven't really looked at it yet. :)
13:36 poikilotherm
LOL
13:36 donsizemore
lego mindstorm time
13:37 pdurbin
Can someone else look at it? :) I don't want to be a bottleneck.
13:38 donsizemore
i can, after 3pm edt?
13:38 donsizemore
but also, what do i know
13:39 pdurbin
donsizemore: thanks! I shuffled around assignees at https://github.com/IQSS/dataverse-kubernetes/pull/87
13:39 pkiraly
@pdurbin, you are welcome!
13:48 poikilotherm
Nice :-D
13:48 poikilotherm
Thx guys for reviewing
13:49 poikilotherm
Phil do you or other guys from IQSS come to Norway 23.-24.1.2020?
13:49 poikilotherm
I just asked my boss where he wants me to go: Norway, Lissabon and/or Brussels
13:50 pdurbin
poikilotherm: Merce is giving a talk in Norway: https://site.uit.no/dataverseno/european-dataverse-workshop-2020/
13:50 pdurbin
looks like pkiraly is too
13:51 poikilotherm
Yeah
13:51 pdurbin
I already have flights booked for Lisbon and Brussels. No plans for me to go to Norway.
13:52 pdurbin
My wife might kill me. :)
13:52 poikilotherm
:-D
13:53 poikilotherm
I would hope to see some devs at UiT
13:53 poikilotherm
I know Slava and Peter are coming, but more devs from IQSS would be awesome
13:56 pdurbin
yeah
13:59 pdurbin
Should I switch from a 3 legged flight to a 4 legged flight? :)
14:03 poikilotherm
Hehehe
14:03 poikilotherm
Sure
14:03 poikilotherm
I would offer you to come to Jülich, too
14:04 pdurbin
5 legged flight
14:04 poikilotherm
Not necessarily. Brussels is reachable by train from here
14:05 poikilotherm
What a tour de europe
14:05 poikilotherm
From near the northest point of Europe near to the southest point
14:15 pdurbin
sounds fun :)
14:18 poikilotherm
Maybe you should hire a private jet and put the Dataverse logo on it
14:25 pdurbin
now you're talkin'
14:25 pkiraly
@poikilotherm, I would say, that somebody will go from Göttingen, maybe two ppl. But it is not yet decided who (I am not a decision maker, and the decision makers are full with other decisions to make).
14:26 pkiraly
I would like to go, that is not a question.
14:26 poikilotherm
pdurbin: https://i.imgur.com/znmB30l.jpg
14:28 poikilotherm
pkiraly: you have to go... You are on that conference schedule :-D
14:28 pdurbin
poikilotherm: the Hindenburg? :)
14:28 poikilotherm
pdurbin: nope, some random image from Wikipedia
14:29 poikilotherm
https://en.wikipedia.org/wiki/Aerial_advertising
14:29 pdurbin
ok, so not https://en.wikipedia.org/wiki/Hindenburg_disaster . phew!
14:35 poikilotherm
You asked for it, you are served right away, Sir. https://i.imgur.com/vOCGjMF.jpg
14:37 pdurbin
oh no! :)
14:44 poikilotherm
Jesus christ, deployment times for Payara 5 are such a pleasure...
14:44 poikilotherm
68s
14:46 poikilotherm
Ok gotta run now, pick up kids
14:46 poikilotherm
Cu tomorrow guys
14:55 gustavo joined #dataverse
15:02 gustavo left #dataverse
16:59 stefankasberger
@pdurbin: i have added examples with (full) to the repo.
17:07 stefankasberger
* with data
17:15 pdurbin
stefankasberger: it's making much more sense now. Thanks!
17:30 donsizemore joined #dataverse
19:10 donsizemore joined #dataverse
20:26 pdurbin
donsizemore: I keep filling up the 8GB disk on these t2.medium instances.
20:27 pdurbin
And I don't even have Docker installed on this one.
21:03 donsizemore
@pdurbin yeah, we bumped jenkins.dataverse.org to 100G
21:03 pdurbin
Right.
21:04 pdurbin
donsizemore: oh, I might ask for some help with getting this code coverage stuff in dataverse-ansible. I'm about to push some docs.
21:04 donsizemore
@pdurbin jacoco #67?
21:05 donsizemore
sorry, monday i wore my "facilities" hat, tuesday and today were job interviews
21:05 pdurbin
yes, exactly
21:05 donsizemore
tomorrow and friday i'm me again
21:05 pdurbin
thank goodness
21:05 donsizemore
i started a branch for #67, i can see where i left things
21:14 pdurbin
donsizemore: ok, but I just made a pull request for the new docs I just wrote. I just requested a review on https://github.com/IQSS/dataverse/pull/6186 . Manana. :)
21:25 donsizemore
excellent! yes, will take a look mañana
21:25 donsizemore
have a great evening!
23:04 andrewSC joined #dataverse
