IQSS logo

IRC log for #dataverse, 2020-04-29

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
07:57 jri joined #dataverse
11:01 Youssef_Ouahalou joined #dataverse
11:33 donsizemore joined #dataverse
13:28 poikilotherm Ola pdurbin
13:29 poikilotherm I just pushed our little fork to our beta instance...
13:29 poikilotherm Now we have CC-BY support :-)
13:29 poikilotherm See https://data-beta.fz-juelich.de/dataset.xhtml?persistentId=doi:10.0346/JUELICH-DATA-BETA/2S0MUQ&version=2.0 for an example :-)
13:29 poikilotherm Waiver change is documented in changelog :-)
13:30 poikilotherm Although it's missing from the detailed changelog :-/
13:53 pkiraly joined #dataverse
13:56 pkiraly Hi, do you happen to know how to run API tests, e.g. the ones in edu.harvard.iq.dataverse.api.AdminIT
13:57 pkiraly What are the preliminary setting I should done. I've created a new Dataverse instance with docker, and run test with mvn test -Dtest=edu.harvard.iq.dataverse.api.AdminIT, but I got a lots of error messages, such as "Dataverse config issue: No API key defined for built in user management", "Endpoint available from localhost only. Please contact the dataverse administrator" etc.
14:03 poikilotherm Hi Peter! :-)
14:04 poikilotherm You could use the docker-aio thingy from the upstream project for this
14:04 poikilotherm I'm really curious to see if we can do things with testcontainers in this area, but this will take some time :-D
14:05 poikilotherm (and I can't focus on that for now...)
14:08 pkiraly poikilotherm, Thanks! "upstream project" means exactly which project? Dataverse, dataverse-docker or something else?
14:08 poikilotherm Dataverse
14:09 poikilotherm IIRC docker-aio is under "conf"
14:09 pkiraly many thanks!
14:10 pdurbin poikilotherm: cool about the CC stuff
14:11 poikilotherm pkiraly: you are most welcome :-)
14:11 poikilotherm pdurbin: yeah, it looks fancy :-D
14:11 pdurbin pkiraly: I just got set up (re-set up) yesterday to run API tests. I followed http://guides.dataverse.org/en/4.20/developers/testing.html#getting-set-up-to-run-rest-assured-tests (but there's one small mistake in there).
14:19 pkiraly pdurbin, Thanks a lot!
14:24 pdurbin pkiraly: sure. I just fixed that mistake: https://github.com/IQSS/dataverse/pull/6867
14:35 juancorr joined #dataverse
14:55 pkiraly For me it seems none of approaches working.
14:55 pkiraly The docker-aio fails with this message: Cannot open: https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-7-x86_64/pgdg-centos96-9.6-3.noarch.rpm. Skipping.
14:56 pdurbin I haven't tried docker-aio in a while. The other day pameyer said he plans to update it from glassfish to payara.
14:58 pkiraly and when I check that directory and there is no such a file in there
15:00 pkiraly I also tried to add the "burrito key", but it failed with this message:
15:00 pkiraly $ curl -H X-Dataverse-key:$API_TOKEN -X PUT -d 'burrito' http://127.0.0.1:8080/api/admin/settings/BuiltinUsers.KEY
15:00 pkiraly { status:"error", message:"Endpoint available from localhost only. Please contact the dataverse administrator"}
15:00 pkiraly I checked the code. There is an isLocalhost() method, and if it fails, this is the result.
15:01 pkiraly it seems neither localhost:8080 or 127.0.0.1 is recognized as localhost
15:01 pdurbin pkiraly: you're having a lot of problems. :( Are you on Windows, Mac, or Linux?
15:03 pdurbin You could try switching from https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-7-x86_64/pgdg-centos96-9.6-3.noarch.rpm to https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-7-x86_64/pgdg-redhat-repo-latest.noarch.rpm
15:03 pdurbin That's what I did in scripts/vagrant/setup.sh in https://github.com/IQSS/dataverse/pull/6816
15:03 pkiraly Linux Ubuntu 18.04
15:04 pkiraly pdurbin, OK, I'll do that
15:04 pdurbin Ok, Linux is good. And do you want to run Dataverse in Docker? Is that your goal? Or do you want to install the Dataverse dependencies on your Ubuntu box?
15:06 pkiraly My goal is to write API test for the API change I've created some days ago. Docker is just a tool for that
15:07 pdurbin sure
15:07 pkiraly I do not necessary want to install a full Dataverse on my machine
15:07 pdurbin ok :)
15:07 pdurbin I could try to summon pameyer. He's the one who created docker-aio.
15:10 pdurbin Heh. Someone just sent me this: https://leereilly.net/github-high-scores/?iqss/dataverse ... donsizemore poikilotherm pkiraly
15:13 pkiraly pdurbin, do you know what does the score represent?
15:13 pdurbin no idea
15:14 pdurbin pkiraly: ok, I emailed Pete.
15:15 pdurbin pkiraly: do you get farther if you change that postgres rpm?
15:19 pkiraly pdurbin, Not yet. It seems that this file is referred in different files, and some of them are generated ones, and I changed first in a file which have been updated during the process with the old version
15:20 pdurbin pkiraly: ok. Be careful or we'll ask you to be the maintainer of docker-aio.
15:21 pdurbin poikilotherm: and you wanted to delete it. Shame on you. :)
15:24 pkiraly I keep going, and I'll report how it goes
15:29 pdurbin pkiraly: perfect. Thanks!
15:39 pkiraly pdurbin, poikilotherm: the Docker has been successfully built, and I am able to run the tests. Thanks a lot for your help!
15:39 pdurbin pkiraly: pull request, please!
15:55 pkiraly pdurbin, https://github.com/IQSS/dataverse/pull/6871
15:58 pdurbin pkiraly: approved! Thanks!
16:01 pkiraly Great, many thanks!
16:01 pkiraly (Hope it'll give me some scores on the dashboard ;-)
16:01 pdurbin heh
17:13 donsizemore @pdurbin I have an idea on jacoco.
17:13 pdurbin donsizemore: nice
17:14 donsizemore gonna test something manually (still cleaning up a bit on python. what i was banging my head on: the python installer uses shutil.copy2. it fails to copy files when launched within ansible)
17:14 donsizemore i tried permutations of shutil.copy(), shutil.copyfile(), python3, python2, still got permission denied copying the files in place.
17:14 pdurbin weird
17:15 donsizemore ansible was previously putting those files in place, so it continues to do so. i'm going with it.
17:15 pdurbin :)
17:15 pdurbin If it ain't broke.
17:17 donsizemore yup. gimme a minute
17:17 donsizemore oh. dumb question?
17:18 pdurbin please go ahead
17:19 donsizemore when we generate the jacoco report, we tell it '--classfiles target/classes' — do we want target/test-classes as well?
17:22 pdurbin That's not a dumb question. And I have no idea. I guess I could try adding it locally to see if I can tell a difference.
17:24 pdurbin donsizemore: it raised the total from 40% to 50%. But is that legit?
17:26 donsizemore i merged my python clean-up branch and am re-running now for good measure
17:27 pdurbin donsizemore: let's leave out target/test-classes. I don't care to see how many lines are executed in the test code.
17:28 donsizemore jenkins' example excludes it, but i wanted to be sure we weren't missing anything
17:28 pdurbin I don't think so. And I'm looking forward to the re-run. I never thought I'd say that.
17:42 donsizemore hey, leftovers are always better on the 2nd day.
17:43 pdurbin some like it in the pot nine days old
17:50 donsizemore those changes should be picked up on the next merge into develop
17:52 pdurbin cool, we have a few small pull requests in the pipeline
18:24 donsizemore i like pull requests
18:48 donsizemore oh, you meant on develop. i can just "build now"
18:48 pdurbin I don't know what I mean. :)
18:48 pdurbin All I know is I think you fixed it, which is awesome.
19:22 donsizemore @pdurbin https://jenkins.dataverse.org/job/IQSS-dataverse-develop/ws/target/coverage-it/index.html
19:23 pdurbin donsizemore: hooray! Take the rest of the day off.
19:24 donsizemore i have meetings
19:24 pdurbin bah
19:24 donsizemore (and java patches, jenkins.dataverse.org is about to blip)
19:41 donsizemore @pdurbin I can submit a PR to correct that link. that's one I can handle!
19:55 pdurbin donsizemore: thanks!
19:57 donsizemore @pdurbin that video game scoreboard makes me long for the original mario brothers
19:58 pdurbin with those turtles
20:05 poikilotherm I'm sure I'll earn some coins soon when #5274 is finally getting resolved. What a journey with you folks :-)
20:06 poikilotherm We're approaching #7000 soon :-D
20:08 pdurbin It doesn't feel that long ago that the guy who opened #4000 was excited about a big round number.
20:09 pdurbin poikilotherm: any news on using the MicroProfile Config API?
20:11 jri joined #dataverse
20:12 donsizemore @poikilotherm 150MB warfile here we come!
20:13 poikilotherm pdurbin nope, focusing on production. Don't look now, but today I deployed the services. Need some tweaking, but we're getting there.
20:14 * pdurbin goes to https://dataverse.org/installations
20:14 poikilotherm donsizemore: small docker images here we come
20:14 poikilotherm Woohoo
20:15 poikilotherm Yeah, https://data-beta.fz-juelich.de is already available...
20:15 pdurbin I like this: https://data-beta.fz-juelich.de/logos/1/FDM-Illustration-cut.png
20:15 poikilotherm But the real thing isn't yet
20:15 poikilotherm The one and only that allows for real DOIs etc ;-)
20:16 poikilotherm I have mixed feelings about it :-D
20:17 poikilotherm There is an idiom/saying here: matter of taste, said the monkey and took a bite of soap
20:18 pdurbin lol
20:18 poikilotherm Geschmackssache, sagte der Affe und biss in die Schmierseife.
20:18 pdurbin I forget if told you this already but a good friend of mine likes to say, "I'm German. I always find the hair in the soup."
20:19 poikilotherm Is there sth similar in AE or BE you are aware of?
20:20 poikilotherm Oh yeah, "das Haar in der Suppe finden" is a VERY german thing.
20:22 poikilotherm Also very german is "Nicht geschmipft ist genug gelobt". Rough translation: no ranting and raving is enough applause when you did sth good.
20:23 pdurbin :)
21:13 pdurbin left #dataverse
23:13 nightowl313 joined #dataverse
23:17 nightowl313 Hi all! Is there a google drive and/or dropbox integration to DV? I did see this: https://github.com/IQSS/dataverse/issues/1746
23:18 nightowl313 nm the dropbox ... I see that option ... just wondering about google drive
23:47 nightowl313 left #dataverse

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.