IQSS logo

IRC log for #dataverse, 2019-10-21

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
07:10 juancorr joined #dataverse
07:19 jri joined #dataverse
07:41 Sharif_DE joined #dataverse
07:42 Sharif_DE Hi all. Good morning from Germany. Could you please tell me the ID & password  for https://github.com/IQSS/dataverse-kubernetes
07:45 poikilotherm joined #dataverse
07:47 Sharif_DE good morning poikilotherm
07:48 Sharif_DE poikilotherm could you please tell me the login ID & password pls for https://github.com/IQSS/dataverse-kubernetes
07:52 poikilotherm https://github.com/IQSS/dataverse-kubernetes/blob/master/docs/secrets.md#provision-a-password-for-your-superadmin-account
07:56 Sharif_DE Thank you poikilotherm
08:00 Sharif_DE poikilotherm, I tried to ingesta DTA file last Friday...there is a problem...I still see the message "Ingest in progress"....could you please help?
08:01 poikilotherm I'm sorry - I'm busy with OA Week today. Need to prepare some things for later
08:01 Sharif_DE poikilotherm, I also see this message: "Dataset Locked – The tabular data files uploaded are being processed and converted into the archival format"
08:02 Sharif_DE Oh, I understand.
08:04 Sharif_DE Could anyone please help?
09:32 Sharif_DE left #dataverse
10:48 pdurbin joined #dataverse
11:30 yoh joined #dataverse
12:05 donsizemore joined #dataverse
12:06 donsizemore @Sharif_DE what version of Dataverse are you running again? there was a dataset locking bug in I think 4.15
12:13 donsizemore @Sharif_DE in either case it sounds like ingest hasn't returned properly
12:15 poikilotherm @donsizemore: he's using 4.16 with dataverse-kubernetes ;-)
12:26 poikilotherm And good morning guys :-)
12:26 donsizemore @poikilotherm i remembered he was using kubernetes, but someone was asking about 4.15 last week
12:27 poikilotherm I think dataverse-docker is still at 4.15
12:27 poikilotherm dataverse-kubernetes is just recently updated to 4.16 ;-)
12:30 pdurbin Don't look now but release notes for 4.18 are being written. :)
12:30 poikilotherm Mornin' pdurbin
12:30 poikilotherm Yeah, I know :-D
12:30 poikilotherm Saw the issue ;-)
12:31 poikilotherm I think djbrooke wants to ship some API stuff  :-D
12:32 poikilotherm pdurbin donsizemore can you guys reproduce https://github.com/IQSS/dataverse/issues/6295?
12:40 pdurbin poikilotherm: yes, thank you for reporting that
12:41 pdurbin poikilotherm: well, the big new feature in 4.18 will be the ability to preview files using external tools from the file landing page. Certain file types. The ones that have previewers already.
12:43 poikilotherm :-)
12:45 pdurbin juancorr and I are going to work on this. I opened "add preview mode" at https://github.com/QualitativeDataRepository/dataverse-previewers/issues/24 and Jim has already added some helpful tips.
12:47 pdurbin donsizemore: when you have a moment (I'm about to head to the gym so I'm thinking later), let's review https://github.com/orgs/IQSS/projects/3#column-5977566 and figure out what's most important for us to work on. We have a lot of irons in the fire.
12:48 pdurbin poikilotherm: same with your "todo" column on my board: https://github.com/orgs/IQSS/projects/3#column-5999026
12:48 pdurbin If anyone else here wants a todo column, please let me know. :)
12:51 poikilotherm OMFG you do have 4 issues for me in there... Let's see if I can get these inline with my agenda :-D
12:52 poikilotherm Hmm I feel dataverse-ansible#101 and dataverse-kubernetes#82 are somewhat connected.
12:53 poikilotherm We should talk about how to get those JMX outside ;-)
12:53 pdurbin poikilotherm: yeah. Are those 4 issues in the right order?
12:53 donsizemore @pdurbin i didn't finish up what i started during my friday afternoon meeting =) today i'm patching our VMware cluster but once that's done i want to finish up friday's work
12:53 poikilotherm pdurbin: most likely I will do CMB first
12:54 poikilotherm Because that's inline with my agenda
12:54 poikilotherm I wanna ship it with 4.17
12:54 donsizemore @poikilotherm I too see 4.16 though i am loathe to dump my precious browsing data
12:54 poikilotherm Prometheus stuff can be postponed, it's only loosly coupled
12:54 pdurbin poikilotherm: cool, I just dragged it to the top. I also posted a related note about metadata blocks at https://groups.google.com/d/msg/dataverse-community/nDMbMv4fKf4/w4Dzqe7lCQAJ
12:55 pdurbin Ok, I put prometheus last.
12:56 poikilotherm tschak·ka
12:56 pdurbin donsizemore: right, you're on https://github.com/IQSS/dataverse-jenkins/pull/18 and that's perfect. I'm moving it to the top of your column.
13:02 donsizemore @pdurbin i'm just adding a group var to specify the job. at first past we hard-coded IQSS-Dataverse-develop
13:04 pdurbin awesome
13:24 jri joined #dataverse
13:53 jri joined #dataverse
14:45 donsizemore @pdurbin i can give you my list of tickets i had sort of pre-selected (if only on paper)
14:46 donsizemore @pdurbin but it sounds like you're blocked running the jenkins role i had only pushed as a somewhat functional example/guide
14:49 pdurbin Well, I have plenty to do. :)
14:50 pdurbin donsizemore: how many of those tickets are on https://github.com/orgs/IQSS/projects/5 and does it make sense to put them all on there?
14:52 donsizemore @pdurbin i can just request that you assign them to me as i go
14:53 donsizemore (and i just finished with our vmware cluster, so i'm doing some mindless service patching until lunch)
14:53 pdurbin donsizemore: sounds good. What's on your list?
14:53 donsizemore i'll start with tidying up the jenkins role, then back to the pullrequestbuilder stuff
14:55 pdurbin That sounds perfect. The next logical step is to run the API tests *before* pull requests are merged. Again, please don't worry about getting fancy with triggers based on comments or whatever yet.
14:55 donsizemore I see that I have 29 GH issues assigned to me; ~20 of those involve IQSS
14:55 donsizemore the trigger was the part that sucked. i'm pretty sure you can run it manually now.
14:56 donsizemore kevin or whoever would want rights on that job to select the source branch
14:58 pdurbin That reminds me of what Kevin does now. He manually switching branches all the time and clicks "Build". Its awesome to hear that this might "just work" now (makes sense) but what are your thoughts on automating this? I'm sorry if I'm not following. Also, let's unassign you from all but a few of those issues!
15:00 donsizemore well, automating it is where I left off... trying to find the proper incantation to make the jenkins plugins happy. where i was going to pick back up this afternoon
15:02 donsizemore if you want i can start with manually testing against a few open pull requests
15:02 pdurbin Sure! Or is this something I could do? Or have Danny try?
15:02 donsizemore then resume tinkering with build plugins
15:03 donsizemore let me take a swipe at running it manually before i waste anybody's time
15:05 pdurbin thank you!
15:10 poikilotherm donsizemore would it help to take a look at my approach for PR building?
15:10 poikilotherm It works pretty smooth right now
15:16 poikilotherm pdurbin: the first persona is documented :-)
15:16 poikilotherm https://github.com/IQSS/dataverse-kubernetes/blob/91-personas/docs/k3s.md
15:30 juancorr joined #dataverse
15:46 pdurbin poikilotherm: cool, but I'm confused. How many personas are there?
15:46 poikilotherm Minikube persona done, too :-) Including ingress
15:47 pdurbin Ok, and what would the next persona be?
15:47 poikilotherm Those are extensions of the demo persona, but with necessary tweaks to make it run on the platforms as easy as possible
15:47 poikilotherm AWS
15:47 poikilotherm I would kindly ask for permission to use the IQSS AWS again...
15:47 poikilotherm Would that be ok?
15:47 pdurbin of course!
15:48 poikilotherm Nice!
15:49 poikilotherm I'm off for today. Moe stuff tomorrow. Feel free to test things and share feedback :-)
15:49 poikilotherm All of this boils down to a very minimum number of commands
15:59 juancorr Hi @pdurbin. I have begun to work with the preview code today. I hope to have a better understand tomorrow.
16:01 juancorr File previewers does not found the Dataverse server when it is under http and not https. I have opened the issue https://github.com/IQSS/dataverse/issues/6296
16:01 jri joined #dataverse
16:33 pdurbin juancorr: thanks!
16:55 donsizemore @poikilotherm I see, you're scanning daily
17:41 donsizemore @poikilotherm ack! multibranch projects attempt to index every branch of the dataverse repo
18:53 donsizemore @pdurbin Author of #11 donsizemore on OdumInstitute/dataverse not in whitelist!
19:09 pdurbin Hmm... what whitelist? :)
19:10 pdurbin donsizemore: oh, Danny and Tania are excited about the idea of using Jenkins to spin up branches to play around with stuff before it gets merged. To make that happen, what is the next steps? Accounts for them and some docs? I feel like we're close.
19:19 donsizemore they can do that now with the ec2 script
19:20 donsizemore I seem to be hitting https://github.com/janinko/ghprb/issues/425 even on new PR creation
19:21 pdurbin donsizemore: right, yes, but in practice I spin up instances for them because they don't love the command line the way I do. :)
19:21 * pdurbin subscribes
19:23 donsizemore of course "Creating a GitHub hook requires that the user which is specified in the GitHub Pull Request Builder configuration has admin rights to the specified repository." may mean i just do it with cron
19:25 donsizemore I manually created a webhook for https://jenkins.dataverse.org/ghprbhook/ and disabled automatic webhook creation in jenkins; that much seems fine
19:28 donsizemore it will actually be easier to do it with the EC2 script than for them to mess around in jenkins
19:30 donsizemore i'm taking a mental health break to the gym
20:15 pdurbin donsizemore: do it. Maybe I can build a little GUI wrapper around that shell script. :)

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.