Time
S
Nick
Message
08:04 espenfl joined #dataverse
08:09 espenfl
Hi there. Anyone here having experience with authorizing against Azure AD? I have set this up in our organization in JupyterHub etc. and that works out of the box. However, when trying this for Dataverse I get `AADSTS90102: 'redirect_uri' value must be a valid absolute URI .`. I find that a bit strange as the url is valid (I get notified that the correct access tokens is not supplied if entering this in the browser) and is the same as recommended he
08:34 espenfl
For instance, where do I find logs for the auth plugins?
08:35 espenfl
I also tried the GitHub one, it takes me to the sign in page, when that is finalized I get to the Dataverse page which includes `Remote system did not return an authorization code.`. So no complaints about the redirect there, even though that also do not work.
12:04 donsizemore joined #dataverse
12:43 yoh joined #dataverse
14:12 poikilotherm
Hmm. espenfl is gone.
14:16 poikilotherm
espenfl in case you're this later: are you using the OpenID Connect connector or the OAuth connector?
14:17 poikilotherm
This sound like a config issue...
15:14 pdurbin joined #dataverse
15:15 pdurbin
poikilotherm: yeah
15:46 pdurbin
donsizemore: so it's a race between North Carolina, Georgia, and Alaska?
15:47 donsizemore
I think the real race at this point is between our branches of government.
15:48 pdurbin
:)
16:06 poikilotherm
Gooooooooood morning America!
16:06 poikilotherm
Congrats to all of you! You just unlocked the "I survived the 2020 election" achievment badge.
16:10 donsizemore
all we have is the popular vote. next we see whether the Electoral College follows suit
16:13 poikilotherm
pdurbin do you have some time for me, maybe giving me a hand with that Postgres stuff? I don't seem to be able to replicate the issues kcondon suffered from...
16:22 donsizemore
@poikilotherm the only thing that jumps out at me is that an organization which may want a newer version of Postgres (server) may bump into backwards-compatibility issues unless they rebuild the warfile with current PGdriver version
16:22 poikilotherm
donsizemore: crossing fingers it works out well!
16:26 poikilotherm
donsizemore: happy to include the most recent driver version in pom.xml
16:26 poikilotherm
Although 42.2.12 is pretty recent, isn't it?
16:27 poikilotherm
And you should still be able to override by adding it to the lib dir
16:27 poikilotherm
IIRC
16:28 poikilotherm
OK 42.2.12 is from 04/2020, 42.2.12 is 10/2020
16:28 poikilotherm
42.2.18
16:31 pdurbin
poikilotherm: yeah, I can help. A call went out on Slack and I answered it. Of course, I've been too busy with other things to do anything yet. What would be most helpful?
16:32 pdurbin
donsizemore: backward compatibility issues? That's no good.
16:32 poikilotherm
With my containerized setup, it's pretty easy to do the update stuff.
16:33 poikilotherm
Im'm not sure how to quickly get my hands on a classic installation to test the steps on such an installation
16:33 poikilotherm
Recommendations?
16:33 pdurbin
I recommend dataverse-ansible.
16:33 poikilotherm
Start a VM and fire of dataverse-ansible with 5.1.1 release, then update?
16:33 pdurbin
Yep. I recommend CentOS 8.
16:34 poikilotherm
donsizemore: how do I update Payara with ansible? Is switching version number sufficient?
16:34 pdurbin
There's a zipurl you can change.
16:36 pdurbin
zipurl: https://github.com/payara/Payara/releases/download/payara-server-5.2020.2/payara-5.2020.2.zip
16:39 donsizemore
@poikilotherm you'll want to update zipurl and the sha256sum
16:40 donsizemore
42.2.12 is very recent, but I promise you someone will want Postgres 14 on 5.2 at some point and bump into the PGdriver version
16:40 pdurbin
donsizemore: so you like the driver and the war decoupled, like it is now?
16:41 donsizemore
pros and cons either way. coupled is fine, especially if overriding it is as easy and dropping it into lib/
16:42 pdurbin
Is it? I have no idea.
16:51 pdurbin
I have a meeting in 10 minutes. Then lunch. No meetings in the afternoon.
17:16 juancorr joined #dataverse
17:23 poikilotherm
Wow. No success with Vagrantfile + libvirt. Seems like I need to feed a few monkeys, lions and another zoo of animals before that works...
17:23 poikilotherm
Back to installing VirtualBox :-(
17:23 poikilotherm
Great.
17:23 poikilotherm
I'll try to setup a test env :-(
17:27 donsizemore
ooh, let me know how vagrant goes with libvirt if you try again?
17:28 poikilotherm
T_T No VirtualBox on Fedora 33. I hate my life.
17:49 poikilotherm
Maybe I found a solution...
17:51 foobarbecue joined #dataverse
17:55 poikilotherm
NFS mounts aren't working ...
18:00 donsizemore
@poikilotherm O_o it's a package in Ubuntu?
18:22 poikilotherm
Most certainly firewall issue
18:22 poikilotherm
Sorry for slow reply - dinner time
18:22 poikilotherm
Back to keyboard
18:23 poikilotherm
Things start to work, but fall apart during Dataverse installation
18:30 poikilotherm
I think that's bad: FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/payara5/bin/asadmin': '/usr/local/payara5/bin/asadmin'
18:34 poikilotherm
Meh. vagrant ssh give me a broken terminal
18:41 poikilotherm
donsizemore tips for deploying Dataverse to a VM with Ansible using Vagrant?
18:41 donsizemore
@poikilotherm I usually just run 'vagrant up'
18:42 donsizemore
@poikilotherm can you send me the ansible output? (and are you using the Vagrantfile in the repo?)
18:42 donsizemore
@pdurbin if I delete conf/openshift/openshift.json, conf/openshift/ will be an empty dir. rmdir it as well?
18:42 pdurbin
donsizemore: well, git doesn't track directories. So yeah.
18:45 donsizemore
@pdurbin I like this "resolve conversation" button. Makes me feel so productive =)
18:46 pdurbin
:)
18:47 poikilotherm
@donsizemore where do you run vagrant up? dataverse or dataverse-ansible?
18:47 poikilotherm
@donsizemore: the dataverse vagrant doesn't use ansible, right?
18:47 poikilotherm
(at least not from what I saw...)
18:47 pdurbin
nope, just shell scripts
18:49 donsizemore
@poikilotherm correct. if you're using dataverse-ansible just run `vagrant up` inside the repo
18:50 donsizemore
@poikilotherm it will read from tests/group_vars/vagrant.yml in case you want to change anything beforehand
18:51 poikilotherm
Oh. I didn't. I used the Dataverse one
18:51 poikilotherm
Can I deploy an arbitrary WAR with that?
18:52 donsizemore
point dataverse_branch at said
18:55 poikilotherm
OK
18:55 poikilotherm
I need to use a different vagrant box, because of libvirt
18:56 poikilotherm
bento/centos-8.2 is not compatible with libvirt :-(
18:59 pdurbin
poikilotherm: you are welcome to spin up an AWS instance with the IQSS account I created for you.
19:02 donsizemore
and there are available keypair slots now =)
19:05 pdurbin
great! thanks!
19:25 poikilotherm
OK after fighting with gpg-agent for SSH keys, I finally see Ansible doing things for me.
19:26 pdurbin
nice
19:28 poikilotherm
Using SSHFS instead of NFS. Relaxing things...
19:29 * pdurbin
feels so relaxed
19:43 poikilotherm
Man this is taking ages to install... :-/
19:43 pdurbin
It's all the R modules, right?
19:44 poikilotherm
donsizemore is it safe to update to payara 5.2020.5 by changing the url and sha256? does it take care of moving data, domain config etc?
19:44 poikilotherm
pdurbin: nope, I disabled those. Currently it's building the WAR file
19:44 pdurbin
poikilotherm: you're running this on EC2?
19:45 poikilotherm
Nope, local
19:45 donsizemore
it will install cleanly
19:45 donsizemore
which takes longer, but is a clean install
19:45 pameyer joined #dataverse
19:45 poikilotherm
OMG
19:45 poikilotherm
It's downloading the internet
19:46 poikilotherm
All Maven deps
19:46 poikilotherm
Now I know why this is taking ages :-D
19:48 poikilotherm
Downloaded the internet and build the WAR in 7 minutes.
19:49 pameyer
that seems remarkably quick for mvn
19:50 pdurbin
pameyer: howdy. I'm gonna hit you with centos questions in a bit. Thanks for leaving comments.
19:57 pameyer
pdurbin: sure thing - I think I missed you last Fri
19:58 pameyer
might be some latency on my end 4-5 due to zoom
19:58 pdurbin
pameyer: oh, and you left a not in IRC I didn't understand. Let me look for it.
19:58 pameyer
one where I was grumbling about stuff that didn't matter, or something useful?
19:58 pdurbin
Oh, the look at me banner. Do you have a screenshot?
20:00 pameyer
I was counting that one as grumbling ;)
20:00 pameyer
sent
20:00 pameyer
google's doing them too - I'd guess it's a new UI fad
20:01 pdurbin
yeah, definitely not just on github
20:02 pdurbin
but yeah, annoying
20:02 pdurbin
occasionally useful :)
20:02 pameyer
probably counts as a "win" for engagement metrics
20:03 pameyer
but I kinda prefer thinking about what I'm using tools _for_, rather than the tools themselves
20:04 pameyer
I'll stop grumbling now ;)
20:04 pdurbin
I have to admit that a lot of these tools are smarter than me.
20:05 pameyer
I've been burned by enough cases where a tool thought it was smarter than it was that I'm cautious about it
20:06 pameyer
... the ones where it was right, I didn't notice
20:11 poikilotherm
OK I'm giving up on Vagrant and Ansible. Too many errors, too much unproductive time waiting.
20:12 pdurbin
poikilotherm: gonna install Dataverse by hand?
20:12 poikilotherm
Don't think so.
20:12 poikilotherm
Most likely use Docker images again
20:13 pdurbin
docker-aio!
20:13 pdurbin
now with centos8! you can test our pull request
20:21 pdurbin
pameyer: ok, ready but no Don. Hmm. Let me go look at your comments again, at least.
20:36 pameyer
most of them were about leaving non-dataverse containers at cent7
20:37 pdurbin
Right. I guess I'm wondering... should we be maintaining those inside the dataverse repo? Maybe they could go to the dcm repo?
20:38 pameyer
arguably - the thinking for having them there was "this is docker-compose of dataverse + optional coupled components"
20:40 pameyer
the complexity of dockerfiles for dcm/rsal vs dataverse seemed to suggest that keeping the compose stuff with the more complex one was the way to go
20:41 pdurbin
yes, Dataverse is complex :)
20:43 pdurbin
I'm not very excited about testing all this stuff. What if we bump the main docker-aio to centos 8 and leave the rest of it alone? I'm testing docker-aio now.
20:43 pameyer
the dream of `docker pull` -> here's a working dataverse
20:43 pameyer
has some way to go
20:43 pameyer
that sounds good to me - main container should be cent8 for sure
20:43 pameyer
my impression is that it might make more sense to handle those in the dcm/rsal repos
20:44 pdurbin
Ok. And if we don't touch the rest we don't have to test it! The perfect crime.
20:44 pameyer
efficiency :)
20:44 pameyer
the prep_it update seem legit to you?
20:44 pdurbin
yes, I changed it locally, good catch, thanks
20:49 pameyer
np - many eyes and all that
20:51 poikilotherm
Guys you saw my #5292
20:51 poikilotherm
?
20:51 poikilotherm
About adding images for Dataverse & Solr in IQSS upstream?
20:52 pdurbin
It's been a while but I'm looking at this epic now.
20:52 poikilotherm
https://github.com/poikilotherm/dataverse/tree/5292-mvn-container
20:52 poikilotherm
I'm waiting for #6819 to be done
20:53 poikilotherm
Throw out as much as possible
20:53 poikilotherm
(from the images in dataverse-kubernetes)
20:54 pdurbin
interesting
20:54 poikilotherm
Make them as slim as possible
20:54 poikilotherm
The less shellscript glue involved, the better
20:55 poikilotherm
I still have that vision about Testcontainers ;-)
20:57 poikilotherm
But Dataverse being a complex application makes progress a snail
20:58 pameyer
I'm vaguely aware - but probably don't have sufficient maven knowledge to have a useful opinion
21:00 poikilotherm
Actually Testcontainers is pretty easy. And there are some excellent Youtube recordings of talks by its maintainers
21:32 pdurbin
Dataverse 5.2 is out: https://github.com/IQSS/dataverse/releases/tag/v5.2
21:38 pdurbin
poikilotherm: when you have time this week, an OIDC question: https://groups.google.com/g/dataverse-community/c/W1jRLUTHEFI/m/Y-ittJZaAgAJ
21:56 pdurbin left #dataverse
22:03 poikilotherm
pdurbin: OK
22:03 poikilotherm
Maybe later
22:03 poikilotherm
Dunno
22:03 poikilotherm
Fixing 6819...
