Time
S
Nick
Message
00:25 donsizemore joined #dataverse
00:25 donsizemore
@pdurbin "SUCCESS" =) https://jenkins.dataverse.org/job/IQSS-dataverse-develop/254/console
00:58 pdurbin joined #dataverse
01:03 pdurbin
SUCCESS! Great! Thank you!
08:26 jri joined #dataverse
09:32 stefankasberger joined #dataverse
10:05 juancorr joined #dataverse
10:48 Youssef_Ouahalou joined #dataverse
11:05 poikilotherm joined #dataverse
11:12 jri joined #dataverse
11:22 Youssef_Ouahalou
Hello everyone I hope you're fine . How do we add the tooltip here: https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/WFB8CW next to description for example?
11:23 poikilotherm
Hi Youssef_Ouahalou, although I have no idea I wanted to let you know that pdurbin and others will be around in a short while.
11:23 pdurbin
Youssef_Ouahalou: hi! Do you mean the tooltip that says, "A summary describing the purpose, nature, and scope of the Dataset."?
11:23 poikilotherm
Heh. Mornin' pdurbin
11:23 poikilotherm
:-D
11:25 pdurbin
mornin, poikilotherm
11:27 pdurbin
Older versions of Dataverse had the same text but you had to hover your mouse over the field name to see it. Here's an example: https://dataverse.ada.edu.au/dataset.xhtml?persistentId=doi:10.26193/DAIUOX
11:28 pdurbin
We switched to the new style in Dataverse 4.12. Here was the issue about it: https://github.com/IQSS/dataverse/issues/3925
11:28 pdurbin
Youssef_Ouahalou: I hope that helps. Time for me to make some coffee. :)
11:38 Youssef_Ouahalou
hahaha ok thank you, in fact I have version 4.11, I have the same tooltip as this one: https://dataverse.ada.edu.au/dataset.xhtml?persistentId=doi:10.26193/DAIUOX
11:52 pdurbin
Youssef_Ouahalou: ok. Sounds like upgrading should fix it. :) Is your installation on the map at https://iqss.github.io/dataverse-installations/ ?
12:03 Youssef_Ouahalou joined #dataverse
12:10 Youssef_Ouahalou
Ok thank you :), no she is not there
12:19 pdurbin
Youssef_Ouahalou: would you like to add her to the map? If so, please email support
12:21 Youssef_Ouahalou
ok nice , thank you soo much :)
12:23 pdurbin
Youssef_Ouahalou: sure! A few minutes after you email that address you should receive a ticket number. Please let me know the number. :)
12:36 Youssef_Ouahalou
this ? #283158
12:49 pdurbin
Youssef_Ouahalou: yes! Perfect. I just created https://github.com/IQSS/dataverse-installations/issues/30 because we are transitioning from the old map to a new map.
12:54 jri joined #dataverse
12:54 JonathanNeal joined #dataverse
13:01 dataverse-user joined #dataverse
13:02 dataverse-user
ok fine thank you soo much @pdurbin :)
13:11 donsizemore joined #dataverse
13:12 pdurbin
You're welcome!
13:15 donsizemore
@pdurbin want me to add https://dataverse.arch.be/ to dataversemetrics? 4.11 qualifies, yes?
13:21 dataverse-user joined #dataverse
13:59 pdurbin
donsizemore: sure! Thanks!
14:04 donsizemore
@pdurbin p.s. are your ears burning? i'm getting a big-picture list of "odum's (and gdcc's) priorities for dataverse" and maybe i'll forward you an e-mail as a rough draft
14:05 donsizemore
@pdurbin so far I've got 4 big-picture thingies
14:15 pdurbin
donsizemore: I love hearing about priorities
14:56 jri_ joined #dataverse
15:09 donsizemore
@pdurbin i know you don't like individual e-mail, but... sent.
15:13 pdurbin
donsizemore: I'm only on the first line but yes, there should be a Consortium Direction board or whatever you want to call it.
15:14 pdurbin
NS is notary service, I assume
15:14 donsizemore
correct. items 1) and 2) were Jon's if you can't tell ;)
15:15 pdurbin
There is a *lot* of dataset page redesign going on. I wouldn't call it 80% done. :)
15:17 pdurbin
I guess the plan sounds fine but I would suggest prioritizing the ability for the core team to spin up all the TRSA stuff next to Dataverse so we can play with it. I've suggested using dataverse-kubernetes for this but if it can all be stuffed into dataverse-ansible, that's fine with me. :)
15:18 donsizemore
@pdurbin we have a docker container for testing
15:19 pdurbin
all the components (including Dataverse) are in a single container?
15:21 donsizemore
just TRSA. it's intended to stand alone from Dataverse anyway
15:21 pdurbin
ok
15:21 poikilotherm
donsizemore: happy to hear that. Plans to push images to Hub?
15:21 donsizemore
if you want a Dataverse container for Akio's trsa-api branch I can make that happen
15:22 pdurbin
poikilotherm: what do you think? Can you stitch together all these Docker images into dataverse-kubernetes?
15:22 donsizemore
@poikilotherm https://hub.docker.com/r/odumunc/trsa-web
15:22 poikilotherm
donsizemore: is this prod ready or only for testing?
15:22 donsizemore
@poikilotherm and I forgot about https://hub.docker.com/r/odumunc/trsa-dataverse
15:23 donsizemore
@poikilotherm some of the workflow/logic is still being decided upon... development in progress
15:23 poikilotherm
Cool. It would be great to include a k8s object somewhere, so this is easy to use
15:24 donsizemore
i wouldn't put k8s and "easy to use" in the same sentence... =)
15:24 pdurbin
I see "Create integrations for impact/TRSA" already at https://github.com/IQSS/dataverse-kubernetes/issues/109 :)
15:24 poikilotherm
donsizemore: LOL.
15:24 poikilotherm
Lots of people on Twitter rant about K8s
15:25 poikilotherm
Actually I don't get the point...
15:25 poikilotherm
It's just a tool
15:25 poikilotherm
Like ansible
15:25 poikilotherm
Or puppet
15:25 poikilotherm
Or git
15:26 poikilotherm
Ok, things have been much more complicated... But the ecosystem is evolving and maturing
15:26 donsizemore
people ranted about docker in its infancy as well
15:27 donsizemore
(i mostly ranted about its proclivity towards filesystem corruption)
15:30 donsizemore
@poikilotherm @pdurbin while I have you both here... suppose I were setting up a Jenkins job to build and deploy the develop branch on Payara 5
15:31 donsizemore
full, web profile, or... dare i say it... micro? we have to go with full right
15:31 poikilotherm
Feel free to take a look at what I did for https://github.com/IQSS/dataverse-kubernetes/tree/63-payara-dev
15:31 poikilotherm
And yeah, full.
15:31 pdurbin
donsizemore: full, please
15:31 poikilotherm
Lots of stuff from that profile needed
15:32 pdurbin
poikilotherm: and once we have Dataverse deployed regularly to Payara we can start building a new UI, right? :)
15:35 poikilotherm
:-D
15:35 poikilotherm
Did you listen to the latest airhacks about Dukescript?
15:35 poikilotherm
Fancy s**t
15:36 pdurbin
Yeah. For my side project we're using Bootstrap 4 and jQuery.
15:36 poikilotherm
<ironic>How oldschool...</ironic>
15:36 poikilotherm
;-)
15:36 pdurbin
yeah
15:37 pdurbin
works fine though :)
15:38 pdurbin
poikilotherm: do you think it's possible to split the "dataverse" git repo into two repos? One for the back end (database, APIs) and another for the front end (JSF and "backing beans")?
15:40 poikilotherm
Well if you can split it into two maven modules, it should be easy
15:40 poikilotherm
That comes back to the topic of "moduliths"
15:40 pdurbin
yeah
15:41 pdurbin
I don't think it's possible.
15:41 poikilotherm
It's though.
15:41 pdurbin
I can certainly imagine a separate repo full of React or Angular code.
15:42 poikilotherm
Urgh
15:42 poikilotherm
Webcomponents
15:43 poikilotherm
+ https://lit-html.polymer-project.org/
15:43 pdurbin
sure, web components sounds fine
15:44 poikilotherm
Ok guys, gotta run now.
15:44 poikilotherm
Cu :-)
15:44 pdurbin
Here we have a web tier and a business tier: https://eclipse-ee4j.github.io/jakartaee-tutorial/overview004.html
15:50 pdurbin
linked from https://jakarta.ee/resources/
15:51 donsizemore
@pdurbin https://jenkins.dataverse.org/job/Dataverse_on_Payara5/1/console
15:51 donsizemore
@pdurbin it's the IQSS-dataverse-develop job with an additional "sed" line
15:53 pdurbin
donsizemore: nice! What's the trigger for that job? It runs when we merge a pull request?
15:55 donsizemore
no trigger just now, but we can make that happen. i was thinking a "build now when we feel like it" on develop periodically
15:55 pdurbin
sounds good
15:55 donsizemore
though i suppose you would want to test pull requests against it, wouldn't you?
15:55 pdurbin
easier on the amazon bill :)
15:55 donsizemore
do you think it would be enough of a rewrite to create a separate dataverse fork?
15:56 pdurbin
sorry, a fork? I'm confused
15:56 pdurbin
the plan for https://github.com/IQSS/dataverse/issues/6230 is not to fork
15:56 donsizemore
or a repo. something that isn't IQSS/dataverse (or should it stay there). ah, ok.
15:57 pdurbin
that issue got estimated as a large, which feels right
15:57 donsizemore
in Dataverse_on_Payara5's current shape, it builds and deploys develop on Payara 5 when you click "build now"
15:57 pdurbin
maybe XXL :)
15:57 donsizemore
i can always change that
15:57 pdurbin
build now is fine, thanks for setting this up!
15:57 donsizemore
"one size fits most?"
15:58 pdurbin
heh
15:58 pdurbin
I'm looking forward to the pull request for 6230
15:59 pdurbin
donsizemore: oh, all this reminds me. Did I tell you that "rewrite the install script from Perl to Python" is in our current sprint?
16:00 donsizemore
excellent! (i mean, phooey. i love perl). i started on that several years ago but trashed what i did
16:00 pdurbin
right, I remember
16:00 pdurbin
The idea is that all the flags and such will still work.
16:02 donsizemore
@pdurbin still getting the validation error: http://ec2-54-174-132-228.compute-1.amazonaws.com:8080/
16:06 pdurbin
donsizemore: yeah. As expected, unfortunately.
16:06 pdurbin
Did you notice the 4.18 in the corner? :)
16:14 donsizemore
it's still trying to talk to DataCite https://jenkins.dataverse.org/job/Dataverse_on_Payara5/ws/target/server.log
16:15 pdurbin
donsizemore: interesting. It shouldn't be trying, right? I assume it's using the FAKE DOI provider.
16:16 donsizemore
correct. that's what we were seeing with the API test suite a few weeks ago
16:16 pdurbin
hmm
16:45 nightowl313 joined #dataverse
16:47 nightowl313
hi all... working my way through getting dataverse installed on aws. I've gotten pretty far...got the ec2 instance behind a load balancer, an rds database, and ssl cert installed so https. Now, trying to set up Oauth2 ... a little confused. I've set up the credentials in google devel console, but since traffic goes through the elb, am I going about this wrong? Do I need to go through aws to set it up? https://docs.aws.amazon.com/elastic
16:48 nightowl313
i'm new to aws and to dataverse, so just trying to struggle through this by reading everything I can find...any help is greatly valued
16:49 pdurbin
nightowl313: well, have you already defined dataverse.siteUrl (a JVM option) and put a valid SSL cert on your server? I think you might need this for OAuth to work.
16:49 pdurbin
donsizemore can probably fact check me on this :)
16:49 nightowl313
i have added the ssl cert through aws ACM
16:50 nightowl313
i used dataverse-ansible to set up the site...I assume it does domain define?
16:50 pdurbin
I don't know what ACM is but ok. :)
16:51 pdurbin
I would double check dataverse.siteUrl. You should be able to find it in domain.xml
16:51 nightowl313
aws certificate manager ... allows me to use the wildcard cert that we have through aws
16:51 pdurbin
ah, ok
16:51 nightowl313
the site is working fine...I can go to it and login fine and create dataverses, etc.
16:52 pdurbin
that's good :)
16:52 nightowl313
just want to allow authentication of org users using oauth2 or shibboleth
16:52 nightowl313
was going to start with shib, but oauth seemed less intimidating .. LOL
16:53 nightowl313
will check the siteURL...thanks!
16:53 pdurbin
nightowl313: I'm sorry but I have to run to a meeting. Folks in here who might be able to help are andrewSC bricas donsizemore jri_ juancorr and stefankasberger. The meeting is 90 minutes long.
16:53 nightowl313
thank you!
16:55 nightowl313
siteURL is the public DNS of my ec2 instance...I think I probably want to change to my elb?
17:00 jri_
siteURL should be your public URL
17:05 nightowl313
okay I changed it...what about the other jvm options related to my instance ... dataverse.fdqn, servername? all are pointing to ec2 public DNS name.
17:06 nightowl313
thank you...btw
17:08 nightowl313
clarification ... they all currently point to public DNS name in aws for the instance...not the public DNS CNAME pointing to the load balancer; I changed the siteURL to the latter
17:10 nightowl313
and now oauth2 works!
17:21 nightowl313 joined #dataverse
17:27 pdurbin
nightowl313: awesome
17:27 pdurbin
jri_: thanks for helping :)
17:29 nightowl313
yes, thanks so much! just a bit confusing to me with that extra layer with the elb. I have a public DNS for the instance assigned by AWS and an A record in our DNS for that, and also a CNAME record for public DNS for ELB, so not sure which URL should be used for all of the different JVM options!
17:30 nightowl313
I think dataverse-ansible just looks at the public DNS for the EC2 instance assigned by AWS and configures the other options based on that.
18:52 pdurbin
Dataverse 4.18 is out: https://github.com/IQSS/dataverse/releases/tag/v4.18
18:59 donsizemore
@pdurbin the M$ login bit may be interesting. i'm both dls
19:06 jri joined #dataverse
19:54 pdurbin
donsizemore: good times. :)
20:37 donsizemore
"you are not hugh. i am hugh."
20:49 pdurbin
only I may dance
22:06 donsizemore
@pdurbin we have a ton of harvest_* and harvest_cleanup_* logs, what pattern are you looking for?
22:28 pdurbin
donsizemore: really I just want the existence of those logs to be documented in the guides
22:28 pdurbin
Thanks for confirming they exist. :)
22:29 donsizemore
i can attach one to an issue (or an e-mail) if you like
22:29 donsizemore
it's essentially XML output from a harvesting run
22:29 pdurbin
oh, XML . interesting
22:30 pdurbin
do you feel like writing some docs? if not, even an issue would be appreciated
22:31 donsizemore
i can create an issue, but Leonid fixed a bunch of stuff in 4.6
22:32 pdurbin
Did he? Good. :) The issue would be something like "As someone who has configured harvesting, I'd like to know where to look when things go wrong"
22:32 donsizemore
Amber's link that she says doesn't work returns what looks like a proper response to me (but I'm no Amber): https://dataverse.scholarsportal.info/oai?verb=ListRecords&set=Carleton-University-Set&metadataPrefix=oai_dc
22:33 pdurbin
Hmm, I thought her email was pretty old. Glad it works now.
22:33 donsizemore
and amber is running "v4.17.5-SP"
22:34 donsizemore
i'll create an issue if about the log locations, but you/danny are correct: they want 4.6 at minimum
22:34 pdurbin
I see. And he's on 4.5.1. Should upgrade.
22:35 pdurbin
Wanna see the visualization I've been working on? Of course you do: https://dev2.dataverse.org/d3/dataverse-homepage-viz/
22:36 donsizemore
the visualization is pretty, but... can you search it?
22:37 pdurbin
Hmm, I guess you could search https://dev2.dataverse.org/d3/dataverse-homepage-viz/data/data.json :)
22:38 donsizemore
can you pull the dataverse thumbnails, if they have one?
22:38 pdurbin
I had that thought. Maybe!
22:38 pdurbin
I was also thinking I could pull the color from the theme, if they set one.
22:39 donsizemore
i like both of these ideas
22:39 pdurbin
Would this be of interest to UNC Dataverse?
22:39 pdurbin
The idea is that it's a visualization for the home page: https://github.com/IQSS/dataverse/issues/5603
23:27 nightowl313 joined #dataverse
