Time
S
Nick
Message
11:35 donsizemore joined #dataverse
11:46 donsizemore
@poikilotherm correct, gdcc-jenkins0n are centos8 and offer podman. i forgot i symlinked /usr/bin/docker to /usr/bin/podman while tinkering with gdcc-jenkins01. adding that to the ansible role now.
11:55 donsizemore
@poikilotherm should be fixed.
12:30 icarito[m] joined #dataverse
12:50 poikilotherm joined #dataverse
12:50 poikilotherm
Thx for fixing donsizemore. Will test later. :-)
12:56 GitterIntegratio joined #dataverse
13:26 donsizemore
@poikilotherm to my simple mind podman offers many of the benefits of docker without the liabilities
14:11 pdurbin joined #dataverse
14:12 pdurbin
mornin' all
14:52 donsizemore
@pdurbin yawn grumble grumble zzzzz
14:55 * pdurbin
fetches donsizemore some coffee
14:56 pdurbin
The long weekend hasn't started yet.
15:05 donsizemore
i'm trying to query github's graphql api to delete the two packages i pushed to their new registry which return a 404 in the web interface
15:06 donsizemore
which may be related to my not being able to return any info on them via the API
15:08 pdurbin
Huh. I've never used that API . Or graphql.
15:11 donsizemore
can you see https://github.com/orgs/OdumInstitute/packages
15:12 pdurbin
I slacked you a pic of what I see.
15:13 donsizemore
yeah. the default image visibility is private, and when i try to access the "landing page" i get a 404
15:13 donsizemore
no little widget to set them at the org level, either. i suspect GitHub packages' beta-ness
15:15 pdurbin
Sure. It's not even 1.0. :)
16:40 nightowl313 joined #dataverse
16:43 nightowl313 joined #dataverse
16:44 nightowl313
:pdurbin question for you about integrating dataverse with primo ... our devs are wondering why you aren't using OAI for that?
16:45 nightowl313
also for anyone else, if we are attempting to use OAI for that integration, what is the best role to use for the user that the api is generated to, to allow search through the datasets?
16:45 nightowl313
thanks for any help
16:48 nightowl313
i would think just member would be sufficient? or maybe not even member ... since everything s/b public?
17:02 nightowl31370 joined #dataverse
17:08 nightowl313 joined #dataverse
17:20 donsizemore joined #dataverse
18:07 pdurbin
OAI is definitely a good way to integrate
18:15 nightowl313 joined #dataverse
18:18 nightowl313
:pdurbin thanks for the response ... just wanted to make sure there isn't some security or other consideration against it for that purpose =)
18:19 pdurbin
My understanding of OAI-PMH is that it's for published metdata, which is public. So I don't see a security concern. Unpublished datasets wouldn't be included.
18:20 nightowl313
i think i see what you mean is that you are harvesting directly from datacite using OAI? not sure I understand that part
18:21 nightowl313
in your email, sorry
18:21 pdurbin
Oh! What email? On the list?
18:22 nightowl313
yea i sent an email to the community a little while ago and you had responded "get metadata from our Dataverse repository into our Primo instance through metadata harvesting from DataCite"
18:23 nightowl313
*we
18:23 pdurbin
I think I found the thread: https://groups.google.com/g/dataverse-community/c/2WZqM8Z6C4A/m/d1GETRFQAgAJ
18:23 nightowl313
i sent a response today ... sorry should stick to one media
18:23 pdurbin
But that's Philipp with an extra p. Not me. :)
18:24 nightowl313
oh my gosh .. so sorry ... ignore me ... i got you two mixed up I should read more closely
18:25 nightowl313
i need a vacation
18:25 pdurbin
No worrieds. :) It does sound like he's harvesting directly from DataCite into Primo.
18:26 nightowl313
yea hopefully he will respond ...thanks for responding here ... we are hoping to go live with our dataverse by oct 1, we have the live site up now and are just working on completing configuration
18:26 pameyer
from that thread, it depends on where and how the api key's going
18:27 nightowl313
yes, our developers asked me to generate an api key but I am unsure of the best way to do that ... we obvioulsy just want public data
18:27 pameyer
but I don't think you need a dataverse api key for reading oai
18:27 pdurbin
He's in Norway so it might be next week. But no holiday for him on Monday, I assume. :)
18:28 nightowl313
that's what I thought .. they can just use the api directly, right?
18:28 nightowl313
the search api
18:28 pameyer
they should be able to - but I don't know anything about OAI from datacite
18:28 pdurbin
Right, no API token needed for OAI.
18:28 nightowl313
perfect... that is really helpful thanks so much!
18:28 pameyer
search API for public datasets also doesn't need a key
18:29 pameyer
but if you do use one, it should be in the header rather than the GET parameters (in the url). I _think_ all of the guides examples got updated, but not 100% sure
18:30 nightowl313
is there any reason to use one? Other than if they are trying to access unpublished data, I guess? which they are not
18:32 pameyer
nope
18:33 pameyer
at least, none I can think of
18:34 pdurbin
We've seen integrations with both OAI-PMH and the Search API . Pick your poison. :)
18:35 nightowl313
great! thanks! i hope i can help with some things on here someday =) Right now everything is a question for me!
18:37 pdurbin
:)
18:38 pdurbin
I'm glad things are moving along with your deployment.
18:39 nightowl313
maybe we'll be on the map soon! =)
18:39 nightowl313
have a great day all!
18:41 pdurbin
you too :)
18:52 pameyer
pdurbin: slightly off topic, but I got a little experience with what some of the tabular data folks run into at times. Had a small ~50MB csv file, needed some semi-interactive plots. turns out, that's "big data" for some programs
18:54 pdurbin
I'm sure vi would open it just fine. :)
18:55 pameyer
yeah :)
18:55 pameyer
my vi skills aren't up to scatterplots though
18:55 donsizemore
you could open it in xemacs and the program and the file should be about even?
18:55 * pdurbin
looks for a plugin
18:56 donsizemore
@pameyer you need python or better yet R
18:56 pameyer
I remember when the ding on emacs was how bloated it was
18:56 pdurbin
pameyer: what did you end up using for the plots?
18:56 pameyer
R was mostly working
18:56 pdurbin
nice
18:57 donsizemore
i have a dummy little script that uses pandas and matplotlib if you want it
18:57 pameyer
I've got a scatter plot - needs a tune-up to figure out what data some of the points corresond to. just need to track down a library, or up my R skills
18:57 pameyer
or figure out how to do it in fortran
18:58 donsizemore
can fortran load a 50MB file? asking for real
18:58 pameyer
50MB files in fortran are no problem
18:58 pameyer
if you've got the RAM
18:59 pameyer
of course, with fortran you might read 49.8MB and hit a file format problem that triggers a segfault. not a perfect world
19:02 pdurbin
I keep learning just enough R to do something and then forget it all.
19:05 pameyer
me too.
19:06 pameyer
sometimes I remember where I left the source from the last time, sometimes I forget that too
20:47 pdurbin
Ok, folks. I'm heading out. To those who celebrate Labor Day, have a nice long weekend. See you Tuesday.
20:47 pdurbin left #dataverse
