Time
S
Nick
Message
01:35 andrewSC joined #dataverse
03:55 jri joined #dataverse
06:09 patrick33 joined #dataverse
07:08 jri joined #dataverse
07:08 poikilotherm joined #dataverse
08:49 jri joined #dataverse
08:52 jri_ joined #dataverse
09:33 poikilotherm joined #dataverse
10:16 pdurbin
Any opinions on this issue I just opened? https://github.com/AUSSDA/pyDataverse/issues/22
10:17 poikilotherm
Good Morning Sir :-)
10:18 poikilotherm
I didn't take a look at pyDataverse yet (shame on me), so I am afraid I can't say anything of value
10:20 poikilotherm
Ok, after re-reading your issue: yes, one should stay with the wording already present for URL /URI
10:22 poikilotherm
pdurbin I saw #5966 yesterday. Is there a particular reason nobody talks about solving 5871?
10:22 poikilotherm
https://github.com/IQSS/dataverse/issues/5871
10:23 poikilotherm
This should mitigate a lot of these troubles in the first place...
10:40 pdurbin
poikilotherm: thanks, I just linked the new pull request to that older issue.
10:43 pdurbin
Making the Flyway problems go away is a lower priority to me than getting off Glassfish 4. Which reminds me, can I have you listen to part of a podcast? Adam Bien interviewing Steve Millidge.
10:45 poikilotherm
Sure.
10:45 poikilotherm
Let me catch my headphone
10:45 poikilotherm
Sitting at the library, the coolest place on campus :-D
10:46 poikilotherm
(And I mean that literally)
10:47 pdurbin
Ok, if you start at 22:55 and listen for a few minutes: http://adambien.blog/roller/abien/entry/payara_full_vs_or_payara
10:48 pdurbin
You might hear reference to an open source project you've heard of.
10:49 pdurbin
a 250 MB war file
10:56 poikilotherm
LOL
10:57 * poikilotherm
listens...
10:59 poikilotherm
Ah I like that british accent :-)
11:00 pdurbin
It's not even true. If you go to https://github.com/IQSS/dataverse/releases/tag/v4.15 you can tell that dataverse-4.15.war is *only* 195 MB . :)
11:00 poikilotherm
:-D
11:01 pdurbin
Of course, if you look at the plot I made for https://github.com/IQSS/dataverse/issues/5593 we'll be at 250 MB before long. :)
11:45 poikilotherm
Hmm he doesn't name Dataverse, maybe there is another project he is helping out?
11:48 pdurbin
poikilotherm: maybe but Steve mentions Xalan and Xerces on the podcast and at https://github.com/IQSS/dataverse/issues/5736#issuecomment-498013126
12:04 poikilotherm
Ok
12:05 poikilotherm
Interesting podcast :-)
12:21 donsizemore joined #dataverse
12:30 pdurbin
You listened to the whole thing?
12:30 poikilotherm
Yeah
12:31 poikilotherm
(Kind of - tried to listen and work in parallel, which is not very easy as a non-native speaker)
12:33 pdurbin
It would be nice if the next time Steve is asked (toward the end) about any interesting applications running on Payara... if he could mention Dataverse. :)
12:35 poikilotherm
:-D
12:42 pdurbin
So what's the next step for getting Dataverse off Glassfish 4.1?
12:43 pdurbin
On Monday donsizemore and I merged https://github.com/IQSS/dataverse-ansible/pull/73 so now we can spin up an EC2 instance running the latest Payara 5 with Dataverse running on it, not very well due to JSF problems.
12:49 poikilotherm
ACtually I have no idea. I am focusing on our auth stuff for now, as we need to get things into production.
12:50 pdurbin
Bummer. Anyone else have any ideas?
13:02 pdurbin
poikilotherm: I don't think you ever got to finish talking about your auth ideas yesterday.
13:02 poikilotherm
Yarp
13:02 poikilotherm
I wanted to give room to people in desperate need of help
13:02 poikilotherm
Shall I continue?
13:03 pdurbin
Heh, sure. When Patrick comes back I'm going to ask him about RANDOM in his server.log. Sure, please go ahead. Or... I'd love to see you work a bit more on https://github.com/orgs/IQSS/projects/4 ... Maybe you could add an auth card to it. :)
13:04 poikilotherm
:-D
13:05 poikilotherm
I asked my colleague about adding a board for FZJ, but he didn't give me an answer yet
13:05 pdurbin
I think you wanted to talk out your ideas before making a new auth issue/card.
13:05 poikilotherm
Yeah. I thought that would make sense
13:06 poikilotherm
Actually, I am figuring out how to run Unity IDM on K8s
13:06 poikilotherm
https://github.com/poikilotherm/unity-idm-k8s
13:06 poikilotherm
(Nothing interesting in there et)
13:06 poikilotherm
+y
13:06 pdurbin
cool
13:07 poikilotherm
What I would like to see down the road from the Dataverse perspective is kind of a non-interactive version of the first login page
13:07 pdurbin
I don't have any opinions on what IDM people should run. Something open source, I guess. :)
13:07 poikilotherm
Recently, when you signup via OAuth2, you will land on the First Login page
13:07 poikilotherm
Ideally when using an IDM, you will receive all details necessary and should only be redirected there when sth required is missing
13:08 poikilotherm
And obviously it would be cool to use Open ID connect as a standard to avoid using "plugins by pull request"
13:09 pdurbin
Tania had a slide about the UX of the login page last week. Let me find it.
13:09 poikilotherm
Nowadays most IAM are capable to use that standard, as many "IdPs" are
13:11 pdurbin
poikilotherm: slide 32 of https://osf.io/8yh3e/
13:11 pdurbin
So now might be a good time for you to open an issue and suggest changes to the login/signup workflow.
13:12 poikilotherm
Oh cool
13:12 poikilotherm
Good to know
13:12 pdurbin
some nice slides on Mr. Potato Head in there too :)
13:14 poikilotherm
Deep link: https://mfr.osf.io/render?url=https://osf.io/8yh3e/?action=download%26mode=render#page=32
13:14 pdurbin
ah, nice, didn't know you could do that
13:15 pdurbin
Mr. Potato Head: https://mfr.osf.io/render?url=https://osf.io/8yh3e/?action=download%26mode=render#page=29
13:16 poikilotherm
This is a bit hacky, but it does the trick :-D
13:16 poikilotherm
Wuahahaha I like Mr. Potatoe
13:17 poikilotherm
Reminds me of https://games.kde.org/game.php?game=ktuberling
13:18 poikilotherm
One day I'll introduce him to my kids ;-)
13:21 pdurbin
just tweeted about Mr. Potato Head and Dataverse: https://twitter.com/philipdurbin/status/1143871737265704960
13:22 pdurbin
poikilotherm: anyway, if you're able to create mockups or screenshots of what you're proposing for the signup/login workflow, it would be great. When I can I use VisBug for this: https://github.com/GoogleChromeLabs/ProjectVisBug
13:23 poikilotherm
Let me write some stuff first
13:23 poikilotherm
I can provide an example page, which might be helpfull
13:24 pdurbin
ok
13:36 pdurbin
donsizemore: is -b "Become" really required?
13:38 donsizemore
unless ansible-playbook is invoked as root
13:38 pdurbin
oh!
13:38 donsizemore
(or with sudo)
13:38 pdurbin
see, I'm learning so much :)
13:43 pdurbin
donsizemore: merged. Now we have Quickstart and Full(er) Usage. Thanks!
13:48 poikilotherm
pdurbin donsizemore: https://github.com/IQSS/dataverse/issues/5974
13:50 donsizemore
:thumbs up:!
13:50 pdurbin
I've only read the title so far but can we change "I[AD]M" to something easier on the eyes? Maybe identity management system?
13:51 poikilotherm
changed it to IDM/IAM
13:51 pdurbin
better
13:52 pdurbin
heh, shibd as a nightmare... at least it works! :)
13:52 poikilotherm
It does for classic installations
13:53 poikilotherm
It will for containers, too
13:53 poikilotherm
But it is a very clumsy thing :-(
13:53 pdurbin
I haven't touched it in years. Since my shibtest server got compromised. :( T-T
13:54 poikilotherm
That tight relation between Apache and Shibd is nowadays a burden
13:54 poikilotherm
At least when going for lightweight services and interchangeable parts
13:54 poikilotherm
It should not matter if you are using NGINX, Apache or another loadbalancer
13:55 poikilotherm
Ah maybe I should add this, too as a benefit: it would be a step forward in getting Dataverse scalable
13:55 pdurbin
My take away from the issue is that you don't want to use mod_shib and shibd. Which is totally legit. You want more flexibility and more options.
13:55 poikilotherm
Aye
14:01 pdurbin
I don't recall ever trying to get Dataverse and Shibboleth working on OpenShift. That's were we worked a bit on scalability.
14:45 poikilotherm
Alright guys, I am outta here. Read you tomorrow
15:20 jri_ joined #dataverse
16:11 bricas_
anyone having issues upgrading from 4.14 to 4.15?
16:12 pdurbin
what kind of issues?
16:13 bricas_
deploy fails
16:13 bricas_
http://paste.arn-fai.net/?2908958
16:16 pdurbin
bricas_: hmm, would you be able to email your server.log file to support
16:19 bricas_
which log exactly -- glassfish?
16:19 pdurbin
yeah, glassfish
16:20 bricas_
sure.
16:20 pdurbin
thanks!
16:20 pdurbin
Is this on a test server?
16:22 bricas_
nope. prod.
16:22 bricas_
rolled back to 4.14
16:22 pdurbin
yikes
16:26 bricas_
sent.
16:27 pdurbin
thanks, https://help.hmdc.harvard.edu/Ticket/Display.html?id=277942 created
16:32 pdurbin
bricas_: what version of postgres are you running?
16:34 bricas_
9.5.14
16:37 pdurbin
Ok. That's why. The reason you're getting that 'remote failure: Error occurred during deployment: Exception while loading the app : javax.ejb.CreateException: Initialization failed for Singleton StartupFlywayMigrator. Please see server.log for more details' error and 'Message : ERROR: syntax error at or near "NOT"' in server.log is that "IF NOT EXISTS" from V4.14.0.1__5822-export-var-meta.sql requires
16:37 pdurbin
PostgreSQL 9.6.
16:37 bricas_
ah.
16:38 bricas_
fyi, i did run the dupe user sql , and it returned 0.
16:38 bricas_
i'll add that to the ticket.
16:38 pdurbin
http://guides.dataverse.org/en/4.15/installation/prerequisites.html#postgresql says "Version 9.6 is strongly recommended because it is the version developers and QA test with" but I don't think that's strong enough. How to you feel about opening a GitHub issue about this? You could also mention that a warning should be added to the 4.15 release notes.
16:42 bricas_
so, interestingly, i didn't realize that i'm on an old pg-server package from before our ubuntu 16.04->18.04 upgrade
16:42 bricas_
and i can technically move to pg 10
16:42 bricas_
but ya, anyone on ubuntu 16.04 i think would potentially have 9.5.x
16:43 pdurbin
Only donsizemore knows if Dataverse works on Postgres 10. I'd suggest using Postgres 9.6.
16:43 bricas_
doesn't seem to be officially packaged for ubuntu
16:44 pdurbin
bah
16:44 bricas_
16.04 has 9.5, 18.04 has 10
16:44 pdurbin
we only use centos
16:44 bricas_
https://packages.ubuntu.com/search?suite=default§ion=all&arch=any&keywords=postgresql&searchon=names
16:48 pdurbin
I'm afraid you're a little on your own when it comes to Ubuntu. We never test with it. You might want to reach out to https://groups.google.com/forum/#!forum/dataverse-community to see who else is running Dataverse on it.
16:50 bricas_
i'm happy to stick with 9.5 if that helps :)
16:50 pdurbin
"IF EXISTS" requires 9.6
16:58 bricas_
https://github.com/IQSS/dataverse/issues/5976
16:59 pdurbin
Thank you!
16:59 pdurbin
when you say "I've filed a separate issue" do you mean ticket? The support ticket?
17:02 bricas_
yes.
17:02 pdurbin
ok, thanks
17:03 bricas_
updated
17:03 pdurbin
thanks!
17:03 pdurbin
sorry for all the trouble
17:04 bricas_
no sweat. rollback worked :D
17:04 pdurbin
in theory, flyway is great
17:04 pdurbin
but now you're stuck on 4.14?
17:04 bricas_
for now, i guess
17:05 bricas_
oh, that reminds me, one of the steps says to optionally replace the solrconfig.xml file, but it doesn't seem any different than what i already have...?
17:06 pdurbin
Right, Oliver mentioned this too.
17:07 pdurbin
bricas_: and Jamie, if you'd like to add a comment to https://github.com/IQSS/dataverse/issues/5969
17:08 pdurbin
Do you (or anyone else here, maybe donsizemore) want to be a pioneer and run Dataverse on PostgreSQL 10 and let us know if anything doesn't work? :)
17:09 bricas_
i might be able to try it out sometime in a test env.
17:10 bricas_
gotta step out of the office for a bit.
17:11 donsizemore
it's a switch in dataverse-ansible... i thought(?) i added the api-test-suite as another switch? i could follow up on both
17:13 donsizemore
@pdurbin how about the postgres apt repo? https://wiki.postgresql.org/wiki/Apt
17:13 pdurbin
Yeah, the postgres version is configurable if you're on centos: https://github.com/IQSS/dataverse-ansible/commit/5885b84b1b7624071fcf145fafa878c649ffc7b7
17:13 pdurbin
I don't know anything about the postgres apt repo.
17:16 donsizemore
dls
17:16 pdurbin
yum
17:16 pdurbin
I mean apt
17:16 donsizemore
you enable it in apt like you'd enable a repo in yum, then you install by versioned package name
17:17 donsizemore
if he doesn't mind dumping and reloading his tables it would get him on 9.6
17:18 donsizemore
there's an in-depth guide for doing this on ubuntu 16 here https://gist.github.com/delameko/bd3aa2a54a15c50c723f0eef8f583a44
17:18 pdurbin
nice, thanks
17:18 donsizemore
but it would be cleaner and safer to dump and reload the tables
17:19 donsizemore
dataverse-ansible uses the postgresql rpm repo, so the version just becomes a string to include in the package name
17:19 donsizemore
a bunch of hooks are hiding in dataverse-ansible to support debian/ubuntu, but... we stuck with rhel/centos
17:22 pdurbin
yeah
17:22 pdurbin
easier to support just one distro
17:34 pdurbin
It looks like dataverse-docker doesn't support "IF NOT EXISTS" either: https://groups.google.com/d/msg/dataverse-community/dsQ6rPOqYIc/QEhDuvtBAgAJ
18:57 bricas_
donsizemore: i'm not generally opposed to custom apt repos, but it does potentially cause problems on os ugprades
19:13 pdurbin
bricas_: in that thread I just linked Valentina is trying to use Ubuntu. You aren't alone. :)
19:17 donsizemore
@bricas_ i've never had an ubuntu os upgrade run smoothly =(
19:19 pdurbin
Ubuntu upgrades on my laptop have been fine.
20:37 pdurbin
sachaj: thanks for opening https://github.com/IQSS/dataverse-installations/issues/2 !
20:56 donsizemore
@pdurbin granted, i've only done ubuntu upgrades in vmware
21:05 jri joined #dataverse
21:21 poikilotherm joined #dataverse
