Time
S
Nick
Message
00:34 jri joined #dataverse
06:18 juancorr joined #dataverse
06:26 juancorr joined #dataverse
06:57 jri joined #dataverse
08:32 jri joined #dataverse
08:41 jri_ joined #dataverse
08:58 juancorr
Morning @pdurbin. I am a little late. We have not changed the :ZipDownloadLimit
09:17 stefankasberger joined #dataverse
09:58 poikilotherm joined #dataverse
10:27 pdurbin joined #dataverse
10:28 pdurbin
juancorr: ok, thanks
10:31 pdurbin
stefankasberger: I just merged https://github.com/IQSS/dataverse-client-python/pull/54 . Thanks. Did you see the pid/indentifier publish bug?
10:36 pdurbin
poikilotherm: https://hub.docker.com/u/dataversebot has your avatar. :)
10:37 poikilotherm
mornin pdurbin
10:37 poikilotherm
Thx for adding
10:37 poikilotherm
Yeah I know :-/
10:37 poikilotherm
Docker uses Gravatar only
10:37 poikilotherm
And right now I have used my mail address
10:38 poikilotherm
Thinking about creating a temporary alias...
10:38 pdurbin
meh, it's fine
10:38 poikilotherm
Not for me :-D
10:38 pdurbin
:)
10:39 pdurbin
There are two owners for iqss on DockerHub. I'm one of them. The other just left Harvard. I guess I should find a new co-owner.
10:41 pdurbin
This is probably going to be a slow week at IQSS, by the way. Some people are taking the whol week off. Thursday is a holiday. Almost everyone is taking Friday off.
10:47 poikilotherm
Ok, good to know
10:47 poikilotherm
https://hub.docker.com/u/dataversebot
10:47 poikilotherm
A happy face
10:47 poikilotherm
Ready to serve
10:48 pdurbin
much better :)
10:49 poikilotherm
Meh Github caches Gravatar, so my face is showing again :-/
10:51 pdurbin
Instead of https://dataverse.org should dataversebot have a more specific homepage to learn more about it?
10:52 poikilotherm
Sure, why not
10:52 poikilotherm
We could create a repo and use GitHub pages to send people to guides
10:53 poikilotherm
Shorter links are nicer
10:53 pdurbin
I could create a DNS entry for you. bot.dataverse.org or whatever.
10:54 poikilotherm
Sounds cool
10:55 pdurbin
We already have https://github.com/IQSS/chat.dataverse.org ... could do something similar.
10:55 poikilotherm
You might think of a dataverse shortlink service
10:55 poikilotherm
Sth like link.dataverse.org/foobar forwarding to guides.dataverse.org/long/link/here/to/sth/whatever
10:56 pdurbin
Hmm. For the community meeting we used http://bit.ly/dataverse2019
10:56 poikilotherm
Yeah, sth like that but with dataverse inside it :-D
10:56 pdurbin
sure
10:56 poikilotherm
Or thedata.org
10:56 poikilotherm
a bit shorter :-d
10:57 pdurbin
After many years in ops I'd like personally like to run as few services as possible. I try to keep iqlogbot alive. And http://chat.dataverse.org .
10:57 pdurbin
My home server.
10:57 poikilotherm
No service involved.
10:57 poikilotherm
Just a website
10:58 pdurbin
I guess if http://guides.dataverse.org went down I'd probably be the one to fix it since I set it up.
10:59 pdurbin
Just a redirect in Apache, you mean?
10:59 poikilotherm
Meh, overkill
10:59 poikilotherm
Static site generator in a Github repo should be good enough
10:59 poikilotherm
Its just a HTTP 302...
11:00 pdurbin
Just use a meta tag in <head> or something? For the 302?
11:00 poikilotherm
https://github.com/jekyll/jekyll-redirect-from#redirect-to
11:02 pdurbin
yeah, looks like it boils down to a meta refresh: https://github.com/jekyll/jekyll-redirect-from/blob/v0.15.0/lib/jekyll-redirect-from/redirect.html#L7
11:02 poikilotherm
Yeah, but less overhead code to write
11:09 mbamouni joined #dataverse
11:09 pdurbin
Well, each redirect is just one line in an Apache config file. And it works with Javascript disabled. But it's good to know about this Jekyll plugin. And I like the idea of it being in git. Thanks.
11:09 pdurbin
mbamouni: hello!
11:12 pdurbin
mbamouni: thanks for helping that fellow who speaks French install Dataverse!
11:17 poikilotherm
pdurbin: I discovered that in POM ScribeJava 3.1.0 is used, while upstream is at 6.3.3...
11:17 poikilotherm
Sry 6.6.3
11:18 poikilotherm
Crossing fingers this will not end in undiscovered regressions... Wondering if we should add integration tests before or just leave it to Kevin :-D
11:21 pdurbin
Is it possible to add an API to Dataverse to test the ScribeJava stuff? It feels heavily dependent on a browser to me. It's probably hard to test with REST Assured or similar.
11:21 poikilotherm
Huh? Browser dependent with OAuth2?
11:22 pdurbin
I'm saying we have tests for Builtin Users in REST Assured. We don't have any API tests for Shibboleth or OAuth users.
11:23 poikilotherm
Sry, I'm puzzled. API tests?
11:23 poikilotherm
Shouldn't there be some integration testing for the providers?
11:24 pdurbin
Yes! Ideally.
11:24 poikilotherm
I can't get Dataverse API tests into the picture. Could you elaborate a bit more on your idea?
11:24 pdurbin
API tests are mentioned here: http://guides.dataverse.org/en/4.15/developers/testing.html#running-the-full-api-test-suite-using-docker
11:25 poikilotherm
Phil I know what your API tests do, its just that I can't figure out what you mean by adding API tests for this
11:40 pdurbin
Sorry, distracted and breakfast.
11:40 pdurbin
Reaching peak chaos here.
11:42 poikilotherm
Take your time :-)
11:44 pdurbin
I'm a little torn. I can keep explaining what I meant but I don't think it matters. All I'm trying to say is that the Dataverse code that uses ScribeJava is only exercised by manual testing. Or users in production. :)
11:45 poikilotherm
:-D
11:45 poikilotherm
Yeah
11:45 poikilotherm
I totally agree with that
11:46 poikilotherm
That's a very cheap kind of e2e testing ;-)
11:46 pdurbin
If we ever measure code coverage of automated tests as I proposed at https://groups.google.com/d/msg/dataverse-dev/ISot5k4VjZQ/t-hzPk8tAwAJ I think all the code that uses ScribeJava will be red (untested) rather than green (tested).
11:49 pdurbin
If you could figure out a way to get some of that code under automated tests before changing it, it would be amazing.
11:50 pdurbin
I've heard "legacy code" defined as "code that doesn't have automated tests". :)
12:52 donsizemore joined #dataverse
13:54 mbamouni
@pdurbin: you're welcome. The french fellow has successfully install dataverse
13:55 pdurbin_m joined #dataverse
13:55 pdurbin_m
mbamouni: fantastic! Thank you!!!
13:56 mbamouni
@pdurbin: you're welcome
13:56 pdurbin_m
mbamouni: do you like Django? :)
13:56 mbamouni
I cant' say that I like but I use it sometimes
13:57 donsizemore
@poikilotherm jenkins.dataverse.org now has 85GB available
13:57 poikilotherm
donsizemore: Nice! Thx :-)
13:57 pdurbin_m
mbamouni: I'm looking for someone to help with https://github.com/IQSS/dataverse-installations/issues/1 . Are you interested? :)
13:58 mbamouni
I can try to help
14:01 pdurbin_m
awesome
14:08 donsizemore
@pdurbin_m i set up miniverse a while ago... i can grep my .bash_history if that's helpful?
14:14 pdurbin_m
donsizemore: that would be extremely helpful
14:16 pdurbin_m
What's a good way to host a Django app?
14:31 pdurbin
And what's a good way to organize it in git?
14:33 mbamouni joined #dataverse
14:34 mbamouni
@pdurbin. I had a network connection problem. So I lost all the prevous messages
14:35 mbamouni
So about django, how can I help. does a thread exist in dataverse google group or anywhere?
14:38 pdurbin
mbamouni: please see "What we have already is this wonderful map we talk about all the time. It's powered by a little database..." at https://scholar.harvard.edu/pdurbin/blog/2019/jupyter-notebooks-and-crazy-ideas-for-dataverse
14:39 pdurbin
mbamouni: also, donsizemore said he might be able to help.
14:40 mbamouni
Ok I will look at this
14:42 pdurbin
mbamouni: thanks. I'm happy to continue talking about datavese-installations here too. I'm happy to answer questions, etc.
14:47 donsizemore
@pdurbin i'll clean up the rst... that was andrey's last submission before he left
14:48 pdurbin
donsizemore: thanks! I just posted some screenshots: https://github.com/IQSS/dataverse/pull/5984#issuecomment-507296193
14:48 pdurbin
This will be a cool feature. BagIt seems like a nice standard.
14:49 pdurbin
poikilotherm: awesome that you have ideas for testing oauth: https://github.com/IQSS/dataverse/issues/5985
14:52 donsizemore
jon wants it for our local preservation strategy
14:52 pdurbin
sure, makes total sense
14:54 donsizemore
@pdurbin i think i deleted our miniverse vm when we stood up dataversemetrics =(
14:55 pdurbin
ah, no worries
14:55 pdurbin
At this point I'm just wondering what the best practices are for organizing a Django application in git and what are some reasonable options for hosting it.
14:59 pdurbin
rigelk: please check out slide 20 about ActivityPub from https://openresearchcloud.app.box.com/s/x6jpycc319k85u6m8qnr5o1w2yp6nbys via "Developing Data Federation Standards" at http://www.openresearchcloud.org/washington-dc-may-22-2019/washington-dc-agenda-and-presentations/
15:10 pdurbin
donsizemore: when you get a chance, there are two new installations we can add to the community metrics page. I just cut a release: https://github.com/IQSS/dataverse-metrics/releases/tag/v0.2.6
15:10 donsizemore
@pdurbin cool. i'm about to cover my eyes and commit my second RST perpetration
15:10 pdurbin
:)
15:10 donsizemore
@pdurbin i don't see why it's formatting those two examples differently than the others
15:11 pdurbin
Want me to hack on it?
15:11 donsizemore
just committed. go for it =)
15:16 donsizemore
@pdurbin just updated dataverse-metrics and am pulling new metrics now
15:20 donsizemore
@pdurbin i managed to get rid of the screwy formatting, but my ToC sub-headings don't show up
15:49 donsizemore
@pdurbin so, i've added unimi and goett to config.json and re-ran, but they don't show up on https://dataversemetrics.odum.unc.edu/dataverse-metrics/ - any particular cache i should nuke? would like to document the fix
15:52 donsizemore
@pdurbin i did run ./update-all-installations-list.sh
16:08 pdurbin
donsizemore: it's probably cached by your browser. Did you try an incognito window?
17:07 donsizemore
@pdurbin me and my silliness. yes on second browser
17:11 pdurbin
donsizemore: so you can see the new installations on a second browser? Good. :)
17:12 pdurbin
donsizemore: oh, http://ec2-52-54-81-198.compute-1.amazonaws.com:8080 seems to be an EC2 instance you spun up. Can I terminate it?
17:44 donsizemore joined #dataverse
17:44 donsizemore
@pdurbin poop, i thought i terminated all those.
17:45 donsizemore
@pdurbin i killed it, sorry.
17:56 pdurbin
donsizemore: "terminated". Thanks!
18:03 donsizemore
@pdurbin gustavo lookin' for you
18:12 pdurbin
donsizemore: heh. Ok. I reminded him this morning that you offered to help look at 500 errors. Not sure if that offer still stands. :)
18:21 donsizemore
@pdurbin i'm playing with 4.15's memory usage now
18:21 pdurbin
perfect
19:37 pdurbin
donsizemore: any hot spots or whatever?
21:19 jri joined #dataverse
