Time
S
Nick
Message
01:38 djbrooke joined #dataverse
01:39 djbrooke joined #dataverse
02:04 djbrooke joined #dataverse
05:19 makmanalp joined #dataverse
12:28 cdsp-rmo joined #dataverse
12:33 cdsp-rmo
pdurbin : hi ! Thank you for your answer on github. But I didn't work :D So, I just made a fresh reinstall of glassfish and wiped out my database
12:34 cdsp-rmo
and I have a strange error the installer script, during the pre-populating database phase
12:34 cdsp-rmo
multiple things like that "psql:../database/reference_data.sql :2: ERROR: relation "foreignmetadataformatmapping" does not exist LINE 1: INSERT INTO foreignmetadataformatmapping(id, name, startelem..."
12:35 cdsp-rmo
all about reference_data.sql
12:36 cdsp-rmo
I don't know if it's related, but my app is not running on glassfish :S
12:40 djbrooke joined #dataverse
12:41 donsizemore joined #dataverse
12:46 cdsp-rmo
also, when I used the upgrade_v4.9.2_to_v4.9.3.sql script, I had errors about "relation "builtinuser" does not exist" :S
12:50 cdsp-rmo joined #dataverse
12:55 cdsp-rmo joined #dataverse
13:09 pdurbin
cdsp-rmo: hi! If you dropped your database and deploying the latest code from develop you don't need to run any SQL upgrade scripts. Those are just for upgrades.
13:09 cdsp-rmo44 joined #dataverse
13:10 cdsp-rmo44
it's not an upgrade script, only the installer.sh script
13:11 pdurbin
ok. hmm
13:12 pdurbin
You dropped your database. That's good. If the war file failed to deploy, you will have no database tables, which is not good. Do you have any database tables?
13:15 cdsp-rmo44
it appears there is no relations
13:15 cdsp-rmo44
in dvndb
13:16 cdsp-rmo joined #dataverse
13:18 pdurbin
tables but no relations?
13:20 cdsp-rmo
dvn exists, but \dt command tells me "No relations found"
13:20 cdsp-rmo65 joined #dataverse
13:21 cdsp-rmo65
(dunno why, I keep dc from the irc)
13:21 pdurbin
cdsp-rmo65: there's a memory leak in chat.dataverse.org: https://github.com/IQSS/chat.dataverse.org/issues/3 . That's why people get disconnected all the time.
13:22 cdsp-rmo65
I am not a big postgres user, but if I remember well \dt is the command line to get all tables from the "on-use" schema
13:22 pdurbin
yes, when I run \dt I see all the tables. this suggests that the war file was not deployed
13:22 pdurbin
because deploying the war file creates the tables
13:23 pdurbin
see "create-tables" at https://github.com/IQSS/dataverse/blob/v4.9.2/src/main/resources/META-INF/persistence.xml#L14
13:23 pdurbin
so we should troubleshoot why the war file wasn't deployed. I'd suggest looking in server.log
13:23 pdurbin
Are you on Mac or Linux?
13:24 cdsp-rmo65
Linux
13:24 cdsp-rmo65
I do have a failed to deploy error just before the psql things
13:24 cdsp-rmo65
Command line: /usr/local/glassfish4/bin/asadmin deploy ../../target/dataverse-4.9.2.war remote failure: Error occurred during deployment: Exception while deploying the app [dataverse-4.9.2] : Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.5.2.v20140319-9ad6abd): org.eclipse.persistence.exceptions.DatabaseException Internal Exception: java.sql .SQLException: Error in allocating a connection. Cause: Class name is wrong or classpath
13:26 pdurbin
ok, database exception. can you please drop your database again?
13:26 cdsp-rmo65
ok
13:26 cdsp-rmo65
done
13:26 pdurbin
if it helps, dropping the database is part of this "rebuild" script I use all the time: https://github.com/IQSS/dataverse/blob/v4.9.2/scripts/deploy/phoenix.dataverse.org/rebuild#L12
13:27 pdurbin
great. now you should rerun the normal "install" script (Perl script)
13:28 cdsp-rmo joined #dataverse
13:29 cdsp-rmo
same
13:29 cdsp-rmo
I mean, same result, command deploy failed
13:30 cdsp-rmo79 joined #dataverse
13:30 pdurbin
ok, can you please drop your database again and switch to the "4966-installer-fixes" branch and try again?
13:30 cdsp-rmo79
ok
13:30 pdurbin
thanks. that's the branch for https://github.com/IQSS/dataverse/pull/5058
13:31 pdurbin
cdsp-rmo79: have you ever used https://www.pidgin.im ?
13:32 cdsp-rmo79
nope
13:33 pdurbin
ok. I'd recommend it to prevent getting disconnected from this channel. The setup should be similar to https://github.com/IQSS/chat.dataverse.org/issues/2
13:35 cdsp-rmo79
rebuilding
13:35 cdsp-rmo79
6 tests failure during build
13:36 cdsp-rmo79
should I bypass the failures ?
13:36 pdurbin
:(
13:36 pdurbin
for now, yes, I guess
13:37 pdurbin
I just want to get your dev environment up and running.
13:38 cdsp-rmo79
as do I :D
13:38 cdsp-rmo79
or, just skipped
13:38 cdsp-rmo79
installer script then ?
13:38 cdsp-rmo79
*ok, just skipped the errors
13:38 pdurbin
yes, if you've already dropped your database
13:38 cdsp-rmo79
yep
13:40 cdsp-rmo79
Attempting to deploy the application. Command line: /usr/local/glassfish4/bin/asadmin deploy ../../target/dataverse-4.9.2.war remote failure: Error occurred during deployment: Exception while deploying the app [dataverse-4.9.2] : Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.5.2.v20140319-9ad6abd): org.eclipse.persistence.exceptions.DatabaseException Internal Exception: java.sql .SQLException: Error in allocating a connect
13:40 cdsp-rmo79
this time, there is no psql errors after this
13:40 cdsp-rmo79
but still no deploy
13:40 pdurbin
:(
13:41 pdurbin
cdsp-rmo79: can you please leave a comment about this at https://github.com/IQSS/dataverse/issues/4966 ?
13:41 cdsp-rmo79
yup
13:42 cdsp-rmo79
it's very strange, I didn't had this problem yesterday
13:42 cdsp-rmo79
I did 2 reinstall of glassfish today
13:42 cdsp-rmo79
(in case)
13:42 pdurbin
I had to reinstall glassfish last week. Frustrating.
13:43 pdurbin
we *could* have you try to get set up on an older version of dataverse, maybe 4.9.1 or so
13:43 pdurbin
and then have you upgrade to the latest in develop
13:43 pdurbin
just a thought
13:45 pdurbin
cdsp-rmo79: since you keep dropping your database there are probably no important secrets in your server.log so you could attach it when you leave a comment on #4966. You'll have to rename it to server.log.txt for GitHub Issues to allow it be attached.
13:46 cdsp-rmo79
well, I had the intent to show my code to some coworkers tomorrow (that's why I wanted to merge with the latest dev, especially if there was a french version available)
13:46 cdsp-rmo79
ok
13:48 pdurbin
the NESSTAR import code?
13:50 cdsp-rmo79
yup
13:52 pdurbin
nice
13:56 pdurbin
you haven't pushed your NESSTAR branch to https://github.com/rmo-cdsp/dataverse/branches yet, right? I don't see it.
13:57 cdsp-rmo79
no, it's on a local branch
13:58 cdsp-rmo79
I wanted to merge with the latest dev
13:58 cdsp-rmo79
but I guess I won't :D
13:59 pdurbin
I would go ahead and push the branch and worry about merging the latest from dev later.
13:59 pdurbin
but it's up to you
14:06 cdsp-rmo79
ok, now there is something strange
14:06 cdsp-rmo79
the branch I was working on cannot deploy too
14:06 pdurbin
:(
14:06 cdsp-rmo79
gonna wipe all my env
14:07 cdsp-rmo79
>:D
14:07 pdurbin
cdsp-rmo79: how do you feel about pushing your branch anyway and asking janetm to try running it? Do you know her? She commented on https://github.com/IQSS/dataverse/issues/4593
14:08 cdsp-rmo79
the problem is that I have to clean some mess on it
14:08 pdurbin
ah, ok. no rush
14:08 cdsp-rmo79
I commented some part of the code because I had troubles publishing datasets
14:08 pdurbin
ok
14:09 cdsp-rmo79
(I talked about it on the issue)
14:09 cdsp-rmo79
I didn't changed all this yet
14:09 cdsp-rmo79
:S
14:10 pdurbin
ok, no worries
14:10 cdsp-rmo79
it seems that everything is going bad since I tried the LANG=C command
14:10 pdurbin
I left a note to myself to mention your troubles at standup in about an hour.
14:10 cdsp-rmo79
may I have did a bad thing with that ?
14:10 pdurbin
I don't think so.
14:12 pdurbin
Oh, when I downloaded your server.log it didn't seem complete.
14:12 pdurbin
Attaching the entire log would help us troubleshoot.
14:12 cdsp-rmo79
ah ?
14:13 cdsp-rmo79
it is complete
14:13 cdsp-rmo79
it's all I have
14:14 pdurbin
It ends with "com.sun.enterprise.admin.cli.AdminMain]]" and I don't see any stacktrace.
14:14 cdsp-rmo79
yes
14:14 cdsp-rmo79
I was as surprised as you
14:14 pdurbin
huh
14:15 pdurbin
very strange
14:15 cdsp-rmo79
to me, there is just vars
14:15 pdurbin
let me wander down the hall and see if the guy who's working on 4966-installer-fixes is in. I need some more coffee anyway. :)
14:16 cdsp-rmo79
okay
14:16 cdsp-rmo79
sorry for the trouble
14:16 cdsp-rmo79
I am murdering glassfish, solrs, psql and the rest
14:16 cdsp-rmo79
to be sure to have the cleanest env
14:19 pdurbin
He's not in yet, but someone just started a fresh pot of coffee, which is awesome.
14:19 pdurbin
He'll be here for standup in an hour.
14:22 donsizemore joined #dataverse
14:25 pdurbin
cdsp-rmo79: https://github.com/payara/Payara/issues/1584 is making me think the problem could be with the postgres driver. Which version of the driver are you using?
14:29 pameyer joined #dataverse
14:30 pameyer
cdsp-rmo79: this may be something you've already checked; but do you have the right jdbc driver in glassfish?
14:30 pameyer
I'm assuming the credentials for postgres are correct, or it wouldn't be able to create the database
14:31 pdurbin
jinx
14:32 pameyer
pdurbin: messages passing in the interwebs...
14:33 pdurbin
bugs passing in the night
14:33 pameyer
better than bugs colliding in the night
14:34 pdurbin
we have those too :)
14:35 cdsp-rmo79
sorry, someone walked in the office
14:35 cdsp-rmo79
hum
14:35 cdsp-rmo79
didn't checked the driver
14:36 cdsp-rmo79
I actually just unzip the glassfish.zip since the beginning of my dev and tests
14:36 cdsp-rmo79
dunno why it changed all of a sudden
14:36 pameyer
I don't have anything solid to point to, but your server log makes me think it would be worth checking the glassfish file permissions
14:37 pameyer
the installer *should* handle the jdbc driver, assuming everything's working
14:37 pameyer
but some of the work on that installer branch is fixing error handling (aka - things were failing that should have stopped the install weren't stopping the install)
14:37 pdurbin
Yeah, the installer should be trying to put postgresql-42.2.2.jar in /usr/local/glassfish4/glassfish/lib or wherever you have glassfish installed.
14:39 donsizemore
@cdsp-rmo79 postgresql-42.2.5 is out, if you want to try it?
14:40 donsizemore
@cdsp-rmo79 nothing sticks out at me in the changelog, but if phil thinks it might be the driver...
14:40 pdurbin
donsizemore: that was from googling for "Class name is wrong or classpath is not set for : org.postgresql.ds.PGPoolingDataSource"
14:40 pdurbin
not sure how pameyer came to the same conclusion
14:40 donsizemore
@pdurbin great minds, natch!
14:42 cdsp-rmo79
preparing solr and trying all of this again
14:42 pdurbin
Cool. Please let us know if /usr/local/glassfish4/glassfish/lib/postgresql-42.2.2.jar is present.
14:49 cdsp-rmo79
42.2.2 installed
14:49 pameyer
donsizemore: do you have any thoughts on the glassfish REST monitoring endpoint and systemd timeouts?
14:50 cdsp-rmo79
still fail :(
14:51 pameyer
cdsp-rmo79: are you running glassfish as root, or its own user?
14:51 pdurbin
cdsp-rmo79: same error? about pg pooling stuff?
14:51 cdsp-rmo79
yes
14:51 cdsp-rmo79
running as root
14:52 pdurbin
same error?
14:52 cdsp-rmo79
yes
14:53 pdurbin
It's annoying that "Please see server.log for more details" is a lie.
14:53 cdsp-rmo79
yes, exactly my thought :'(
14:53 cdsp-rmo79
I didn't reinstalled psql yet
14:53 cdsp-rmo79
I may give it a try
14:54 pdurbin
What version of Postgres are you using?
14:54 cdsp-rmo79
in case I didn't clean well enough ...
14:54 cdsp-rmo79
9.5.14
14:55 pameyer
might be worth checking the postgres auth first. aka psql -U $pg_user_for_dv -h localhost dvndb
14:55 cdsp-rmo79
ohoh
14:55 cdsp-rmo79
"PostgreSQL 9.6 is recommended to match the version in the Installation Guide."
14:55 pameyer
sometimes it's set to allow local connections via non-socket stuff
14:56 cdsp-rmo79
maybe that's a thing ? But why it would not work now ...
14:56 pdurbin
yeah but older versions should probably work. should
14:56 pameyer
ah - yeah, if you haven't changed the configs from a working install that shouldn't be broken
14:56 cdsp-rmo79
it's like all of a sudden
14:57 cdsp-rmo79
gonna test something, back in 3 mins (need to reboot)
14:57 pdurbin
I'm still using Postgres 8.4 on one of my test servers. But yes, we recommend 9.6.
14:58 pdurbin
And I think we're starting to use some 9.x features. I forget.
14:58 donsizemore
@pdurbin the big one I remember was 9.4's JSON support
15:02 pdurbin
donsizemore: I was thinking of the "concat" function added in postgres 9.1: https://github.com/IQSS/dataverse/issues/4675#issuecomment-389510477
15:03 pdurbin
But these days I think we're saying devs are welcome to use concat.
15:03 pdurbin
and other stuff in postgres 9.x
15:04 pdurbin
donsizemore: Akio is our Slack now, by the way. :)
15:04 donsizemore
@pdurbin i know, i was secretly jealous
15:05 pdurbin
why he no IRC ?
15:06 donsizemore
I can ask him
15:07 pdurbin
it's ok
15:07 pdurbin
he should come to the community meetings too so I can ask him :)
15:21 cdsp-rmo joined #dataverse
15:26 cdsp-rmo
okay
15:26 cdsp-rmo
I may have find the problem
15:26 cdsp-rmo
which is weird, but it may be a rights problem
15:27 cdsp-rmo
starting the script as sudo erased any problems ...
15:30 cdsp-rmo
but that doesn't really explain the problem
15:31 cdsp-rmo
nothing has really changed, why all of a sudden ? I don't think I skipped any rights for glassfish or solr, still the same process ..
15:32 cdsp-rmo
gonna try the latest develop branch and see how it works now
15:39 pameyer
cdsp-rmo: if glassfish is running as root, and you were running the installer as non-root; I'd expect that to fail
15:46 pdurbin
pameyer: good point
15:46 pdurbin
cdsp-rmo: are you running the installer as root?
15:47 cdsp-rmo
right now, yes
15:47 cdsp-rmo
previously I didn't
15:48 pdurbin
ok
15:48 * pdurbin
crosses fingers
16:07 cdsp-rmo
okay, so pre-populating the database seems to work except somewhere
16:08 cdsp-rmo
CREATE INDEX psql:../database/reference_data.sql :33: ERROR: column "email" does not exist LINE 1: ...index_builtinuser_lower_email ON builtinuser (lower(email)); ^
16:08 cdsp-rmo
after that, I got this:
16:08 cdsp-rmo
% Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 1082 100 1082 0 0 52585 0 --:--:-- --:--:-- --:--:-- 54100 It appears that the Dataverse application is not running... Even though the "asadmin deploy" command had succeeded earlier. Aborting - sorry...
16:08 cdsp-rmo
this is with the installer script
16:10 cdsp-rmo
and no application is running
16:10 cdsp-rmo
if I try to deploy manually, I got a "Deployment encountered SQL Exceptions:"
16:11 pdurbin
cdsp-rmo: please don't worry about the builtinuser error
16:11 cdsp-rmo
ok
16:11 cdsp-rmo
so, I got problems only with my glassfish then
16:12 pdurbin
Can you please remind me which branch you're on?
16:12 cdsp-rmo
now develop
16:12 cdsp-rmo
latest
16:12 pdurbin
ok, perfect
16:12 pdurbin
because I asked at standup and the preference is for you to create a new issue please
16:13 cdsp-rmo
ok
16:14 pdurbin
it's a weird error... was the deployment successful or not?
16:14 cdsp-rmo
no
16:14 cdsp-rmo
the script create the database, but fail to deploy the app
16:14 pdurbin
hmm
16:15 pdurbin
there's another log to check
16:15 pdurbin
I think it has "install" in the name
16:15 cdsp-rmo
it says this
16:15 cdsp-rmo
It appears that the Dataverse application is not running... Even though the "asadmin deploy" command had succeeded earlier. Aborting - sorry... OK, the Dataverse application appears to be running... using default contact email for root dataverse Executing post-deployment setup script setup-all.sh... done! Making additional configuration changes...
16:15 cdsp-rmo
when I try to deploy it manually on glassfish, given that the database has been created by the script
16:16 cdsp-rmo
a big pack of SQLException appears, saying that some relations already exists
16:16 pdurbin
yeah, that's normal, the warnings about existing relations/tables
16:16 pdurbin
it's because of that "create-tables" thing we use
16:17 pdurbin
Does http://localhost:8080/api/info/version return anything? That's a way to check if the war file was deployed.
16:18 donsizemore joined #dataverse
16:18 pameyer
cdsp-rmo the installer reports that it failed when it succeeds
16:19 pameyer
I usually go with pdurbin's suggestion to check api/info/version
16:24 cdsp-rmo
404 not found
16:24 cdsp-rmo
from glassfish
16:25 pdurbin
/usr/local/glassfish4/bin/asadmin list-applications
16:25 pdurbin
That's how I check if the war file was deployed also. ^^
16:26 cdsp-rmo
yes, that's usually how I do it
16:26 pdurbin
ok, just checking :)
16:26 cdsp-rmo
hum
16:26 cdsp-rmo
got an error EJB Timer Service is not available in the logs
16:26 pdurbin
oh!
16:26 cdsp-rmo
not the first time I see this
16:27 pdurbin
please see http://guides.dataverse.org/en/4.9.2/admin/troubleshooting.html#deployment-fails-ejb-timer-service-not-available
16:27 pdurbin
in short, I very often stop glassfish, rm -rf generated, and start glassfish again
16:27 pdurbin
undeploy the war file before stopping glassfish too
16:28 pdurbin
I usually don't worry about the "Delete all the rows from the EJB__TIMER__TBL table in the database;" step because I'm so quick to drop my database.
16:33 cdsp-rmo
okay, now it's deployed
16:34 cdsp-rmo
but I got a blank page
16:34 cdsp-rmo
...
16:34 cdsp-rmo
api/info/version works
16:34 cdsp-rmo
4.9.2
16:35 pdurbin
ok! good! progress! at this point you're sort of like the phoenix server so you might be able to use those scripts
16:36 pdurbin
I run these scripts all the time. "prep", then "rebuild", then "post" at https://github.com/IQSS/dataverse/blob/v4.9.2/scripts/deploy/phoenix.dataverse.org/deploy
16:37 pdurbin
"prep" is optional. I just adjust the name and description of the root dataverse
16:37 pdurbin
"rebuild" drops the database, clears solr, etc
16:37 pdurbin
"post" runs setup-all.sh and friends
16:38 pdurbin
Now that your installation of Glassfish is configured, is able to let the war file be deployed, those scripts should work.
16:39 pdurbin
"post" does some extra stuff at the end that you don't need
16:39 cdsp-rmo
okay
16:39 pdurbin
ok, and you should not run the "pg8-createsequence-prep.sql " line in "post". that's for postgres 8.x
16:40 pdurbin
sorry this is so confusing
16:40 cdsp-rmo
no, I understand
16:40 cdsp-rmo
the only thing confusing me now, is "why I have a blank page" for my instance :D
16:40 pdurbin
it's because you don't have a root dataverse
16:40 pdurbin
probably
16:40 cdsp-rmo
so, I comment the pg8 line
16:40 cdsp-rmo
ah
16:41 cdsp-rmo
oh
16:41 cdsp-rmo
that's what happens where there is no root ?
16:41 cdsp-rmo
the installer usually does it, that's it ?
16:41 pdurbin
right
16:42 cdsp-rmo
ok
16:42 pdurbin
here's where the root dataverse is created: https://github.com/IQSS/dataverse/blob/v4.9.2/scripts/api/setup-all.sh#L65
16:42 cdsp-rmo
so, I comment the pg8 line of post script then use it ?
16:42 pameyer
usually creates root, but doesn't publish it
16:43 pameyer
so if you're not logged in, it would look like an empty page / redirect to login page
16:43 cdsp-rmo
ok
16:43 pdurbin
cdsp-rmo: you need "createsequence.sql " but I would comment out everything else after that
16:43 cdsp-rmo
ok
16:45 cdsp-rmo
hum
16:46 cdsp-rmo
psql: FATAL: Peer authentication failed for user "dvnapp"
16:47 pdurbin
did you set postgres to "trust"?
16:47 cdsp-rmo
that's what I am checking
16:48 cdsp-rmo
I don't remember the name
16:48 cdsp-rmo
pg_hba.conf ?
16:48 pameyer
yup
16:48 pdurbin
yep, please see http://guides.dataverse.org/en/4.9.2/developers/dev-environment.html#install-postgresql
16:58 cdsp-rmo
okay, no error
16:58 cdsp-rmo
except this
16:58 cdsp-rmo
scripts/database/reference_data.sql : No such file or directory
16:59 cdsp-rmo
oh
16:59 cdsp-rmo
am I supposed to run this script in a speacial "place"
16:59 pdurbin
yeah, from the root of the repo
16:59 cdsp-rmo
:D
17:00 pdurbin
again, sorry :)
17:00 cdsp-rmo
nah, I should have known that
17:00 cdsp-rmo
it was in the script
17:00 cdsp-rmo
right in front of me
17:00 cdsp-rmo
><
17:01 cdsp-rmo
ok, it's running and doing stuff
17:01 pdurbin
\o/
17:05 cdsp-rmo
I some 500 internal server error
17:07 cdsp-rmo
by taking a look at glassfish logs, I see this
17:07 cdsp-rmo
Communication failure detected when attempting to perform read query outside of a transaction. Attempting to retry query. Error was: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.5.2.v20140319-9ad6abd): org.eclipse.persistence.exceptions.DatabaseException Internal Exception: org.postgresql.util.PSQLException: Connection has been closed.
17:08 cdsp-rmo
for each query it seems
17:08 pdurbin
yikes
17:08 pdurbin
how are you triggering that error?
17:09 pdurbin
creating a dataset?
17:09 cdsp-rmo
I
17:09 cdsp-rmo
don't know
17:09 cdsp-rmo
I mean, the script started by "deleting all data from Solr"
17:09 cdsp-rmo
ah
17:09 cdsp-rmo
this errors are triggered for
17:09 cdsp-rmo
"Setup the metadata blocks"
17:11 pdurbin
hmm
17:11 cdsp-rmo
7 calls
17:11 cdsp-rmo
then it's "Setting up admin role"
17:11 cdsp-rmo
Setup the metadata blocks % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 1368 100 1368 0 0 45 0 0:00:30 0:00:30 --:--:-- 355 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd "><html xmlns="http://www.w3.org/1999/xhtml "><head><title>GlassFish Server
17:11 cdsp-rmo
oh god, what have I done
17:11 cdsp-rmo
sorry
17:14 cdsp-rmo
ah
17:14 cdsp-rmo
got an error "parse error: Invalid numeric literal at line 1, column 10"
17:14 cdsp-rmo
for "Setting up the root dataverse"
17:15 cdsp-rmo
every requests finish with a 500, quite messy
17:15 cdsp-rmo
finished
17:18 cdsp-rmo42 joined #dataverse
17:18 cdsp-rmo78 joined #dataverse
17:21 Cdsp-rmo joined #dataverse
17:21 Cdsp-rmo
Well, it's getting late, got to leave the office :S
17:23 Cdsp-rmo
I am now getting a 500 page from glassfish on api/info/version
17:23 pdurbin
bah
17:23 pdurbin
go home! sorry this is so hard
17:24 Cdsp-rmo
No need, it happens
17:24 Cdsp-rmo
And I dunno why, but I'm sure I do something bad in this
17:24 Cdsp-rmo
Will figure out one day maybe
17:24 Cdsp-rmo
Ah
17:25 cdsp-rmo24 joined #dataverse
17:25 cdsp-rmo24
maybe I did something bad
17:26 cdsp-rmo24
I restarted psql by updating the pg_hba file
17:26 cdsp-rmo24
maybe I should have restarted glassfish ?
17:26 pdurbin
I restart glassfish a lot.
17:27 cdsp-rmo24
okay
17:27 cdsp-rmo24
it's white again
17:27 cdsp-rmo24
and version works
17:28 cdsp-rmo24
will restart the script
17:28 cdsp-rmo24
ok, no more 500 per request
17:28 cdsp-rmo24
it's doing REAL stuff
17:28 cdsp-rmo24
and it's ...
17:28 cdsp-rmo24
working
17:28 cdsp-rmo24
\o/
17:29 cdsp-rmo24
with french text
17:29 cdsp-rmo24
and I can log in
17:29 cdsp-rmo24
what a wonderful world
17:31 cdsp-rmo24
thanks a lot for the help
17:31 cdsp-rmo24
leaving work, but still around on the phone
17:31 pdurbin
heh, what a wonderful world!
17:43 pdurbin
pameyer: https://dev1.dataverse.org/sitemap.xml
17:43 pdurbin
it's a start :)
17:44 pameyer
incremental progress :)
18:04 Mahsa joined #dataverse
18:05 Mahsa
Hi, @pdurbin , @pameyer
18:05 Mahsa
I hav a quick Shibboleth question
18:05 Mahsa
I was able to test dataverse with testshinb, etc , and we are trying to use SSO wihin our organization now
18:06 pameyer
hi Mahsa
18:06 Mahsa
I am seeing this error when we are redirected to dataverse from SSO : The SAML assertion for "eppn" was null. Please contact support.
18:07 Mahsa
I found this page https://groups.google.com/forum/m/#!msg/dataverse-community/PXHKNX6m-eU/MZv6qBEWCwAJ where it is disscused but did no get much from it
18:07 Mahsa
Can you let me know what should be the format/value of the eppn attribute ?
18:08 pameyer
Mahsa: pdurbin might be able to help you there; but that's past my knowledge of shib
18:08 Mahsa
Thanks pameyer, I will wait for him to respond then
18:14 donsizemore
@Mahsa I don't mean to butt in, but has your IdP released the Research and Scholarship Attribute set to your Dataverse SP? Alex was trying connecting Dataverse to Shib through Drupal/PHP (and succeeded)
18:16 pameyer
donsizemore also knows more than me about shib :)
18:16 pdurbin
Mahsa: I'm glad TestShib worked. Does your institution's IdP release "eppn" or something else like NameID?
18:26 Mahsa
@pdurbin, they do not issue eppn , not sure about NameID
18:26 Mahsa
I can ask them about NameID
18:29 Mahsa
@donsizmore : no our IDp has not released the Research and Scholarship Attribute set
18:30 Mahsa
but they created a customized attribute for eppn and I asked them to set its value to email address
18:30 Mahsa
Does that email addres necessarily end in ".edu" ?
18:31 Mahsa
As an aside, our users have a Unique ID assigned to them , I can ask IDP people to set eppn to that if this works
18:36 pdurbin
Mahsa: that would be perfect, putting the unique id in "eppn"'
18:37 Mahsa
Ok,so their email address is unique too, how come this is not working with email ?
18:38 pdurbin
Well, both "email" and "eppn" are required. Here's the list: http://guides.dataverse.org/en/4.9.2/installation/shibboleth.html#shibboleth-attributes
18:39 pdurbin
But you're saying that they put email addresses in eppn? That should work. It may not be the best long term solution since email addresses can change.
18:39 yoh_
pdurbin: ;-) see you there?
18:39 Mahsa
Ok, so making sure I understand it well, our institution does not provide "eppn" attribute, but they created a custom attribute for us under that name and set its value to email address
18:40 Mahsa
This is not working with error : eppn null
18:40 pdurbin
Right. That should work.
18:40 Mahsa
mhmm ,
18:40 pdurbin
Do you see "eppn" at https://dataverse.example.edu/Shibboleth.sso/Metadata (for your URL )
18:41 pdurbin
bah, sorry, wrong url
18:41 pdurbin
Do you see "eppn" at https://dataverse.example.edu/Shibboleth.sso/Session (for your URL )?
18:42 pdurbin
There's an example of what that "Session" page should look like at http://guides.dataverse.org/en/4.9.2/installation/shibboleth.html#exchange-metadata-with-your-identity-provider
18:42 pdurbin
yoh_: I was already there. Chicago. Two weeks ago. Where where you? :)
18:42 Mahsa
No eppn in Metadata
18:42 Mahsa
I will just check the Session
18:42 pdurbin
yes, the Session one is important
18:43 pdurbin
if it isn't in "Session" it isn't being passed to Dataverse
18:45 Mahsa
Ok, good news, the attributes part of the session is empty :-)
18:46 yoh_
pdurbin: ah, cool, ... 2 weeks ago - was home ;)
18:46 Mahsa
so this means there is a Shibboleth config issue ?
18:46 pdurbin
yep
18:47 pdurbin
that test takes Dataverse out of the picture
18:47 pdurbin
the "Session" test
18:47 Mahsa
mhmm, I see, mhmm
18:48 Mahsa
Any suggestion on how to trubleshoot this ?
18:49 pdurbin
well, you could check how "Session" looks when you use Test Shib
18:50 pdurbin
for Test Shib you should see an "Attibutes" section with stuff like "eppn: myself
18:50 pdurbin
Attributes*
18:50 Mahsa
Ok, Thanks pdurbin! I will start there .
18:51 pdurbin
sure, it sounds like you're going to need to talk some more with your identity people
18:53 Mahsa
mhmm, I doubt they can help, they only ask for the metadata file and produce Idp metadata
18:53 Mahsa
I will start with testshib again
18:53 Mahsa
and check the session attributes this time and if it worked fine, bug the Idp people again :_)
18:54 pdurbin
:)
19:01 Mahsa
A quick Q, should I provide IDp people with Attributes-map.xml file so they know what attributes they should provide ?
19:03 pdurbin
I guess it wouldn't hurt.
19:40 Mahsa
I just tested our dataverse with testShib again and checked the Session. The attributes are populated and things are working fine.
19:41 Mahsa
So does this narrow down the Shibboleth config problems to our IDP metadata ?
19:41 Mahsa
Or you think there could be other sources into the issue ?
19:53 pdurbin
Mahsa: yes, I think this helps narrow down the problem. Your IdP needs to send you more fields.
21:58 donsizemore joined #dataverse
21:59 donsizemore
I meant to post this earlier today, but Odum is hiring! https://unc.peopleadmin.com/postings/148457
