IQSS logo

IRC log for #dataverse, 2019-10-16

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
05:32 stefankasberger joined #dataverse
06:46 poikilotherm joined #dataverse
07:00 jri joined #dataverse
07:20 sivoais_ joined #dataverse
07:38 poikilotherm woohoo pdurbin is back :-D
08:10 jri_ joined #dataverse
08:11 jri__ joined #dataverse
09:38 stefankasberger joined #dataverse
10:11 poikilotherm Oi pdurbin, you around?
10:48 pdurbin poikilotherm: sort of. The kids will be waking up soon. How was your vacation?
10:49 poikilotherm Nice. Started to build the drywall metal skeleton in my roof :-)
10:50 poikilotherm Looks like you and many others @IQSS have been on vacation, too?
10:50 pdurbin We have a skeleton in our front yard now. My daughter insisted. Monday was a holiday so a lot of people took off extra time. My parents were visiting.
10:51 poikilotherm Nice :-D
10:51 poikilotherm Ok I just looked up "Unterkonstruktion": s/skeleton/substructure/
10:53 poikilotherm https://www.knauf.de/cutout/cutout_1042315_popup_landscape_4x3_1.jpg
10:55 pdurbin They remind me a bit of metal studs. Thin ones. But I knew what you meant by skeleton. Around here Halloween is coming.
10:56 poikilotherm Our neighbors just announced they will have a graveyard in front of their house for Halloween
10:56 poikilotherm We'll see ;-)
10:57 pdurbin increasing in popularity according to https://en.wikipedia.org/wiki/Geography_of_Halloween#Germany
11:03 Youssef_Ouahalou joined #dataverse
12:14 poikilotherm pdurbin: https://i.imgur.com/ITEAmog.png
12:14 poikilotherm I'm approaching salvation for IQSS/dataverse-kubernetes#22
12:16 pdurbin scheduled image builds? nice
12:17 pdurbin Also, updateSchemaMDB.sh just works and it's awesome. Thank you. I just tried it for the first time.
12:23 poikilotherm :-)
12:23 poikilotherm You're most welcome
12:36 kamil83 joined #dataverse
12:37 pdurbin Meanwhile, it looks like pkiraly is asking for help with switching Solr to something called "managed schema": https://github.com/IQSS/dataverse/issues/5989#issuecomment-542606658
12:44 kamil77 joined #dataverse
12:45 kamil43 joined #dataverse
13:16 donsizemore joined #dataverse
13:24 poikilotherm ALright pdurbin, I just solved #22 :-)
13:24 poikilotherm Docker Hub is a mess right now, throwing error 500 all over
13:24 poikilotherm Need to clean up a bit
13:24 poikilotherm Can we talk about docroot storage?
13:25 poikilotherm (https://github.com/IQSS/dataverse-kubernetes/issues/65)
13:28 pdurbin_m joined #dataverse
13:28 pdurbin_m poikilotherm: sure!
13:28 poikilotherm :-)
13:30 poikilotherm Would you prefer to talk at a keyboard?
13:30 poikilotherm ... while sitting at a keyboard
13:31 pdurbin_m I would. Can you please comment on https://github.com/IQSS/dataverse/pull/6192 ?
13:31 pdurbin_m Gustavo wanted to talk to you about scribejava last week.
13:31 poikilotherm I'll be around for about 1:15 before picking up kids
13:32 poikilotherm Yeah, he reached out via mail
13:32 pdurbin_m oh, great
13:32 poikilotherm I responded ;-)
13:32 pdurbin_m any news? any plan?
13:33 poikilotherm I am not sure what to say... :-D
13:33 poikilotherm He asked me if I had to do any changes to the Oauth2 implementations
13:34 poikilotherm Well, there is a PR... All changes documented...
13:34 poikilotherm So I don't know what he really means
13:34 poikilotherm Maybe I missunderstood sth.
13:36 poikilotherm Should I just point him to the PR politely? Maybe he just missed it?
13:36 poikilotherm Oh, I could request a review from him
13:36 poikilotherm (ANother one, he already did one)
13:38 pdurbin_m I think we're trying to figure out if we should ask CIMMYT to upgrade scribejava. Maybe you could leave a comment about that.
13:42 pdurbin_m Something like, "Please go ahead and upgrade scribejava in this pull request. It will make my life easier later."
13:46 juancorr morning @donsizemore . I has seen that you are a developer of the dataverse-previewers. Could I open a issue to translate it (and a pull request if you are interested)?. We have used the jquery.i18n javascript library (https://github.com/wikimedia/jquery.i18n)to do the translation.
13:48 juancorr You can see some examples from the e-cienciaDatos dataverse repository: https://piwik.consorciomadrono.es/dataverse-previewers/previewers/PDFPreview.html?fileid=1417&siteUrl=https://edatos.consorciomadrono.es&datasetid=772&datasetversion=1.1 https://piwik.consorciomadrono.es/dataverse-previewers/previewers/SpreadsheetPreview.html?fileid=1418&siteUrl=https://edatos.consorciomadrono.es&datasetid=772&datasetversion=1.1 ...
14:10 pdurbin juancorr: yes! Please go ahead and create an issue and pull request! Great stuff!!
14:11 pdurbin poikilotherm: I'm at a full sized keyboard now if you want to talk about docroot storage. Also, does what I said about scribejava make sense?
14:11 poikilotherm I had you CCed in my response to Gustavo
14:12 poikilotherm It would make sense, when my PR https://github.com/IQSS/dataverse/pull/5997 wouldn't be 95% done
14:12 poikilotherm The only thing left is testing with ORCID
14:12 poikilotherm Does that in return make sense? :-D
14:13 donsizemore @juancorr I'm merely a user! but absolutely yes send them a pull request
14:14 pdurbin poikilotherm: as you know, I favor SLOPI communication. :) I'd recommend leaving a comment on https://github.com/IQSS/dataverse/pull/6192 because it'll come up naturally in about an hour at standup. I could summarize whatever you write there.
14:15 pdurbin Or even do a "talk after" so we can all read whatever you write.
14:15 juancorr Thanks pdurbin and donsizemore I am creating them.
14:15 pdurbin juancorr: thank you!!
14:16 pdurbin juancorr: while you're creating issues, you could create one at https://github.com/IQSS/dataverse/issues with a title like "As a translator, I'd like to know which external tools are translatable"
14:17 jri joined #dataverse
14:18 poikilotherm https://github.com/IQSS/dataverse/pull/6192#issuecomment-542724030
14:19 jri joined #dataverse
14:19 poikilotherm Oh shit - go upgrade sudo ASAP
14:19 poikilotherm https://www.sudo.ws/alerts/minus_1_uid.html
14:22 pdurbin poikilotherm: thanks!
14:22 pdurbin Looks like Danny replied already.
14:23 jri_ joined #dataverse
14:24 poikilotherm Re :-D
14:26 poikilotherm OK pdurbin: docroot. Did you ever try to put the docroot on a symlink?
14:26 poikilotherm I am fiddling with moving it to /docroot in the container, so it will not be a blowup once changing to a different appserver using a different domain
14:27 poikilotherm It would be cool to have it configurable in glassfish-web.xml and the uploader code, but this does not work for GF4.1 - no variables allowed. Newer versions of Payara support that, GF 5.1 unknown
14:28 poikilotherm I know that you need to enable symlink support in glassfish via that XML or in the virtual server, but I could not get that to work :-(
14:28 poikilotherm It's really strange
14:30 poikilotherm You said you fiddled around with those docroot stuff a while ago, so I was wondering if you have some ideas for me...
14:32 pdurbin I've pretty much only installed Dataverse on a single server so I've never had to deal with docroot problems and multiple Glassfish servers.
14:33 poikilotherm Ok
14:33 poikilotherm Guess I'll have to lock'n'load, shooting at Glassfish till it works :-/
14:33 pdurbin donsizemore: have you ever installed Dataverse on multiple Glassfish servers?
14:36 pdurbin When I had interns at Red Hat working on scaling Dataverse to multiple Glassfish servers I totally forgot to have them check for that logos bug.
14:37 poikilotherm Yeah. It would be cool to have Dataverse configurable to be truly stateless within the appserver, but that's a dream for another night
14:37 pdurbin Yeah. How much time before you pick up the kids?
14:37 poikilotherm 10 min
14:37 pdurbin yeah, manana
14:38 pdurbin Maybe you have time to look at the spreadsheet I created to compare app servers.
14:38 poikilotherm Ah I owe a reply to Gustavo on that thing, too
14:38 pdurbin https://docs.google.com/spreadsheets/d/1TVVErG_zFC6k4Fnjz8rJ9VJxMD_xGJSk7OwVjQOLXaQ/edit?usp=sharing via https://github.com/IQSS/dataverse/issues/6230#issuecomment-536746128
14:38 poikilotherm Sure, slap me hard with that spreadsheet
14:39 pdurbin I recently updated it because Payara is now listed at Jakarta 8 compatible.
14:40 pdurbin juancorr: thanks for creating https://github.com/IQSS/dataverse/issues/6277 !
14:43 poikilotherm Meh. I just got it working. This must have been some bitchy stuff with JRebel and debugger active
14:43 poikilotherm With 4.16 release and no agents this worked with symlinking the docroot
14:43 poikilotherm That way it can live at /docroot and is easier targeted by volume mounts
14:44 poikilotherm Alright guys, gotta go. pdurbin I left two comments so far on your spreadsheet
14:44 pdurbin Should we make docroot a database setting? Or a JVM option? Would that help?
14:44 poikilotherm Read you all tomorrow
14:44 poikilotherm Nope, you can#t.
14:44 donsizemore @pdurbin Jon threatened that I may have to do that but so far we're running in one VM
14:44 pdurbin ok, enjoy those kids
14:44 poikilotherm No way to get that var inside the config of glassfish-web.xml
14:45 poikilotherm At least not in GF 4.1
14:45 poikilotherm Cu all
14:45 pdurbin donsizemore: ok, no plans to support multiple glassfish servers in dataverse-ansible, right? Seems like it would be a pain. I'm thinking that's what dataverse-kubernetes is for.
14:46 donsizemore @pdurbin it wouldn't take much work to enable that in ansible
14:47 donsizemore @pdurbin i may beg off our 3pm today, i've been slammed and really don't have much to report
14:47 donsizemore @pdurbin i've been slammed and the PR plugin doesn't seem to want any of the milk or cookies i've offered it
14:47 juancorr pdurbin: thanks to you.
14:48 pdurbin donsizemore: heh, no worries about begging off. You've done so much that we have plenty of new toys to play with. Thanks!
14:48 donsizemore @pdurbin I think the PR workflow is basically there, if I could get the PR builder to trigger the way it's supposed to
14:49 pdurbin donsizemore: honestly, Danny is fine with just always triggering a build on a new pull request for now. We could figure out the magic "run tests" stuff later.
14:50 donsizemore @pdurbin there doesn't seem to be a proscribed way to do it (that works)
14:50 pdurbin bummer
14:50 pdurbin well, when I get a minute maybe I'll spin up Jenkins and mess around with that plugin you found. There's a link to it somewhere?
14:53 donsizemore yes, let me update the XML file in the github repo
14:53 pdurbin donsizemore: thanks!
14:53 donsizemore (or i can e-mail you, since i'm loathe to upload a non-functional job XML file)
14:53 pdurbin you could push it to a branch called "milk-cookies-scratch1"
14:54 pdurbin that's what I do
14:54 donsizemore @pdurbin i think "ice cream and cookies" was the original analogy
14:54 pdurbin juancorr: oh, did you know that we'd like to add a "preview" mode to external tools? Maybe you can help us add one to Data Explorer. :)
14:54 pdurbin donsizemore: yum
15:31 pdurbin donsizemore: ok, I just talked about automated testing stuff at standup and my plan is to actually test https://github.com/IQSS/dataverse-jenkins/pull/18 . I assume you don't mind if I pile on to your branch with more docs or whatever.
15:42 pdurbin juancorr: you translated the file previewers too?!? https://github.com/QualitativeDataRepository/dataverse-previewers/pull/18 Amazing! THANK YOU!
15:44 pdurbin donsizemore: also, you're of the hook at 3pm. Meeting canceled. :)
16:02 dataverse-user joined #dataverse
16:42 donsizemore @pdurbin i'll never turn down free documentation!
16:49 dataverse-user joined #dataverse
17:07 pdurbin :)
17:18 pdurbin donsizemore: spinning down old ec2 instances first. Sorry if I killed one you were using.
17:26 pdurbin donsizemore: when I `git checkout OdumInstitute/master` I'm warned that I'm in detached HEAD state so I hope you don't mind if I cherry-pick your commit into a new branch. I'm thinking your pull request addresses both https://github.com/IQSS/dataverse-jenkins/issues/3 and https://github.com/IQSS/dataverse-jenkins/issues/4
17:27 donsizemore @pdurbin where's your head at? (don't let the walls cave in on you)
17:27 pdurbin :)
17:28 pdurbin I made a new branch called 3-4-ec2. I haven't pushed it yet. Spinning up Jenkins now.
18:01 donsizemore joined #dataverse
18:01 donsizemore @pdurbin so you died on config.xml?
18:03 pdurbin No, it was just a warning. But now I have other questions. I think I'll post a screenshot.
18:04 donsizemore @pdurbin it's been a while since i submitted that PR; i'll have to take a look
18:04 pdurbin I'm probably doing something wrong.
18:04 donsizemore i may not have tested it enough
18:07 pdurbin donsizemore: I just added a couple screenshots: https://github.com/IQSS/dataverse-jenkins/pull/18#issuecomment-542823791
18:09 donsizemore @pdurbin XML import failure?
18:10 donsizemore @pdurbin the rest of the job is basically identical to IQSS-Dataverse-Develop
18:10 pdurbin Partial failure, I guess. I seem to be missing the postbuild stuff.
18:11 pdurbin Right? Or am I looking at this wrong?
18:11 donsizemore @pdurbin looks like Jenkins barfed importing the config XML
18:12 pdurbin sure, but I think that's unrelated
18:12 pdurbin or maybe it is related?
18:13 pdurbin When I ran import-job.sh there was no output.
18:15 pdurbin There is no config.xml file anymore. We renamed it. So I think that's unrelated.
18:23 pdurbin Hmm. It doesn't think any plugins are installed. Maybe I should restart Jenkins.
18:27 pdurbin I restarted Jenkins and now "list-plugins" shows some (and I see some in the GUI) but I don't see the "Job Import" plugin.
18:46 donsizemore @pdurbin that was honestly just an example. i'm much more interested in getting the jenkins configs working then installing it from the ground up
18:47 pdurbin Me too. Well, I'm interested in both. I got a different result (but not everything) after installing the job-import-plugin. Want me to post another screenshot?
18:48 donsizemore @pdurbin sure, that's fine
18:52 pdurbin donsizemore: here you go, another screenshot: https://github.com/IQSS/dataverse-jenkins/pull/18#issuecomment-542841681
18:53 pdurbin looks closer to yours, I guess
18:56 donsizemore i think we just need to add some plugins. let me make it through this week and i promise i'll take a look next week?
18:57 pdurbin Sure! If it's ok with you, I'll park these issues and pull requests in "community dev" so they don't come up at standup every day.
18:58 donsizemore perfect. i think i just need to update the plugin list
18:59 pdurbin awesome, I'll switch gears to trying to get the API test suite passing on EC2
20:19 donsizemore @pdurbin on jenkins. i think i'm just guilty of tinkering with the job config after the PR. on those rsync options. i tested on an older version than you and i have on 10.14.6!
20:30 dataverse-user left #dataverse
20:52 pdurbin I was thinking about just deleting that rsync flag and giving it a whirl. Just duly reporting what I see. :)
20:53 donsizemore "it worked under Linux" =)
20:55 pdurbin :)
21:12 donsizemore okay, jenkins' plugin usage plugin sez i'm using plugins i didn't ask to use (jira?)
21:36 pdurbin manana
22:42 sivoais joined #dataverse

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.