Time
S
Nick
Message
01:11 jri joined #dataverse
03:27 jri joined #dataverse
06:37 juancorr joined #dataverse
06:59 jri joined #dataverse
07:10 poikilotherm joined #dataverse
08:15 MrK joined #dataverse
08:44 stefankasberger joined #dataverse
08:59 stefankasberger joined #dataverse
09:14 pdurbin
stefankasberger: whoa! `pip install pyDataverse` is now a thing! Congrats and thank you!! https://twitter.com/stefankasberger/status/1130752131881947142
09:23 stefankasberger
thanks! :)
09:33 pdurbin
and you're giving a talk: https://dcm2019.sched.com/event/PVPb/pydataverse-a-python-api-wrapper
09:35 pdurbin
But do you have time to make a pull request to add pyDataverse to the list of client libraries in the API Guide?
09:35 pdurbin
stefankasberger: if you want, I'll create the issue and you can create the pull request. :)
09:36 stefankasberger
PR to master?
09:37 pdurbin
no, "develop"
09:37 pdurbin
git flow
09:43 stefankasberger
k. will do it later.
09:44 pdurbin
stefankasberger: no rush, do you happen to know https://github.com/TomMiksa ?
09:45 pdurbin
I'm asking because I owe him a reply at https://github.com/IQSS/dataverse/issues/5859#issuecomment-493978167
09:51 stefankasberger
No, but it seems we know a lot common people.
09:51 pdurbin
cool :)
09:57 poikilotherm
stefankasberger: Dataverse DE meeting will happen on 3rd of June. As you wrote you can't make it, who is coming from AUSSDA, as Dorothea wrote your org will be present...?
09:59 stefankasberger
Iris Butzlaf. She is doing preservation and is already in Göttingen on the day (she did her PhD there, when I am right).
09:59 poikilotherm
Ah great :-)
10:34 pdurbin
poikilotherm: did you still want me to look at your new docs? I didn't get very far the other day.
10:34 poikilotherm
Sure. Go ahead :-)
10:35 pdurbin
well, I'm asking because I have a long list but let me look quick right now
10:35 poikilotherm
:-D
10:35 poikilotherm
Thanks
10:35 pdurbin
Is your new diagram in here somewhere?
10:36 poikilotherm
The architecture is not in there, but the sequence diagrams
10:36 pdurbin
Ok, and everything you'd want to read is linked from the README?
10:36 poikilotherm
Yeah
10:37 poikilotherm
YOu might skip the demos
10:37 poikilotherm
Depends on your time ;-)
10:37 pdurbin
I don't have time. Maybe you could record an asciicinema or whatever it's called. :)
10:38 poikilotherm
LOL
10:39 pdurbin
I've never heard anyone say "Pick your favorite poison." It's always "Pick your poison." I don't know why.
10:39 pdurbin
"Let's get ready to Dataverse..." is deliciously good. :)
10:42 pdurbin
Heh. "Buildah" is in here. I first heard about it at http://irclog.iq.harvard.edu/dataverse/2019-05-08#i_92704
10:43 pdurbin
typo: "knowning"
10:44 pdurbin
heh, "slimer"
10:49 pdurbin
ok, I just created https://github.com/IQSS/dataverse-kubernetes/pull/54 to fix those tiny things. otherwise the docs look fantastic! thank you, poikilotherm !
10:50 stefankasberger joined #dataverse
11:01 poikilotherm
Thx! Merged :-)
11:01 pdurbin
sure :)
12:18 donsizemore joined #dataverse
13:05 pdurbin
donsizemore: mornin. Thanks again for fixing the SQL script. Do you plan to try again with the EC2 create script? I'm asking because our API test suite is still down because postgres on phoenix isn't new enough. :( 9.6 is now a hard requirement.
13:05 donsizemore
@pdurbin oh, i tested with EC2 before submitting the PR. we may want to find a better solution before making 9.6 the minimum PG version...
13:07 pdurbin
well, if we cut a release now, 9.6 is the new minimum but I hear you
13:08 poikilotherm joined #dataverse
13:08 pdurbin
I guess I'm wondering if you've had any luck with running the API test suite from new Jenkins. I've lost track of where we are and I'd like to help if I can. On a related note, we had a long discussion about automated testing during tech hours yesterday (a topic poikilotherm cares about) and I'm thinking I might write up some thoughts and post them to the dataverse-dev list.
13:09 donsizemore
@pdurbin that reminds me: yesterday I noted @pameyer's open issue about test failures
13:09 poikilotherm
Dingdong, I'm back :-)
13:10 poikilotherm
donsizemore I've been wondering if I could reuse some of your ansible things to create an Kubernetes Operator based on the Operator Ansible SDK
13:11 donsizemore
@poikilotherm you're welcome to, and feel free to whip my script kiddie mess into shape
13:11 pdurbin
donsizemore: which of his 36 open issues are you talking about? :)
13:11 donsizemore
@pdurbin n/m, i was thinking of #4719
13:12 pdurbin
hmm, that one is closed
13:14 donsizemore
@poikilotherm also, today i'm stepping through dataverse-kubernetes on minikube just for fun
13:14 poikilotherm
Yeah :-)
13:15 poikilotherm
I wonder if I should create a tweet about the project, maybe it attracts more people
13:16 poikilotherm
Need more input ;-)
13:17 donsizemore
bootstrapping now
13:17 poikilotherm
donsizemore, in case of any question or things that don't work for you, open an issue or ask here :-)
13:18 donsizemore
i got validation errors during deployment but they may not matter
13:18 poikilotherm
They are normal :-(
13:18 donsizemore
i do wish kubernetes reported such things as warnings rather than errors
13:18 poikilotherm
In the logs?
13:19 donsizemore
to stderr. i got one for each kustomization.yaml
13:19 donsizemore
oh, where do i wish they went? to a logfile, yes
13:20 poikilotherm
Oh I thought you were talking about Glassfish validation errors
13:20 donsizemore
error: error validating "k8s/utils/postgresql/kustomization.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
13:20 donsizemore
doesn't look like there's much to be invalid, tho
13:20 poikilotherm
Interesting!
13:21 poikilotherm
Which kubectl version are you using?
13:21 donsizemore
1.14.1
13:22 poikilotherm
Ok cool. I'll try to reproduce. Could you open an issue? These errors should not be thrown and intend a defect
13:22 donsizemore
i blame me, but i'm not sure how
13:29 donsizemore
poopycakes. dataverse-799cd744fd-kk6x5 0/1 CrashLoopBackOff 3
13:29 poikilotherm
Logs please :-)
13:30 donsizemore
dataverse-799cd744fd-kk6x5 logs look normal for dataverse
13:30 donsizemore
bootstrap-dataverse-sdncr is still in Init:2/3
13:30 donsizemore
but i'm only at 11m, should i wait 15?
13:31 poikilotherm
Nope, the deployment to glassfish seems to have failed
13:31 poikilotherm
Are you on Minikube 1.1.0 and Kubernetes 1.14.2?
13:32 donsizemore
yes, i just updated minikube before starting
13:33 poikilotherm
Nice
13:35 poikilotherm
Did you follow the HOWTO or did you use the Kustomize switch?
13:40 donsizemore
i used your minikube demo instructions
13:41 poikilotherm
Ok thx. About the errors: this is a limitation of current kubectl :-(
13:43 poikilotherm
Hmm at least I should adapt pathes in the HOWTO ;-)
13:50 poikilotherm
donsizemore have you seen [AutoDeploy] Successfully autodeployed : /opt/dataverse/appserver/glassfish/domains/domain1/autodeploy/dataverse.war in your logs
13:50 poikilotherm
?
13:56 pdurbin
poikilotherm: if you want more input on dataverse-kubernetes you could make a pull request to add it to a future version of this page: http://guides.dataverse.org/en/4.14/installation/prep.html#choose-your-own-installation-adventure :)
13:56 poikilotherm
:-D
13:57 poikilotherm
Yeah, I am working on that...
13:58 pdurbin
great!
13:59 donsizemore joined #dataverse
14:03 donsizemore
@poikilotherm the dataverse pod is crabbing about the rserve password alias but otherwise it's chugging along
14:03 poikilotherm
So it was in "ready" state?
14:04 donsizemore
no, it keeps restarting
14:04 donsizemore
i do see Selecting file /opt/dataverse/appserver/glassfish/domains/domain1/autodeploy/dataverse.war for autodeployment
14:04 poikilotherm
But no "successfully autodeployed"?
14:04 donsizemore
then hibernate validator
14:04 donsizemore
then [#|2019-05-22T14:04:24.208+0000|SEVERE|glassfish 4.1|javax.enterprise.system.tools.deployment.common|_ThreadID=83;_ThreadName=deployment-jar-scanner;_TimeMillis=1558533864208;_LevelValue=1000;| Exception while visiting module-info.class of size 192 java.lang.IllegalArgumentException at org.glassfish.hk2.external.org.objectweb.asm.ClassReader.<init>(ClassReader.java:170) at org.glassfish.hk2.external.org.objectweb.asm.ClassReade
14:05 poikilotherm
Yeah those are all pretty normal
14:06 poikilotherm
The autodeploy message should be at the very end, followed by timer messaged
14:07 donsizemore
my last entry is Command start-domain failed. The DAS was stopped.
14:08 poikilotherm
Great. Any error messages before that?
14:08 * poikilotherm
crosses fingers there are...
14:08 donsizemore
there are 3: Exception while visiting module-info.class of size 192
14:09 donsizemore
Exception while visiting META-INF/versions/9/javax/xml/bind/ModuleUtil.class of size 4234
14:09 donsizemore
Exception while visiting module-info.class of size 506
14:09 donsizemore
all in org.glassfish.hk2.external.org.objectweb.asm.ClassReader.<init>
14:11 poikilotherm
Meh. Nothing that should break the deployment
14:12 poikilotherm
And I could not reproduce it :-(
14:13 donsizemore
virtualbox is churning away, it may just be resource-bound
14:23 poikilotherm
Are you on Linux? You could try KVM2 driver
14:29 donsizemore
installing
14:34 poikilotherm
Ha!
14:35 poikilotherm
Now it failed for me, too
14:35 poikilotherm
This might be related to memory issues
14:42 donsizemore
oh. yeah, minikube only gave itself 2GB
14:45 donsizemore
trying again with 8
14:48 poikilotherm
donsizemore I need to go pickup kids now... I'll try to investigate later. It looks like the deployment is eating my laptop...
14:48 donsizemore
@poikilotherm go go! i'll watch the HD activity light blink over here...
14:48 poikilotherm
That was better with older releases. Maybe sth. changed there, too
14:49 poikilotherm
My Minikube is getting unresponsive and failing
14:49 donsizemore
i blame @pdurbin
14:49 poikilotherm
LOL
14:49 poikilotherm
IF you have the time, please try with an older image like 4.12
14:49 donsizemore
don't look now, but it's failing earlier and faster
14:49 poikilotherm
(You just need to change the tag in the K8s object)
14:49 donsizemore
i may blow it all away and start over
15:11 donsizemore
@poikilotherm I'm sad to report that I get the same result using 8192GB of RAM and the KVM2 driver. I'll drop the version back and try again
15:14 * pdurbin
blames himself
16:50 donsizemore joined #dataverse
16:57 jri joined #dataverse
17:27 jri joined #dataverse
17:39 pdurbin
donsizemore: thanks for adding docs to https://github.com/IQSS/dataverse/pull/5861
17:39 donsizemore
@pdurbin i was wondering whether to ping you about that. unordered list vs. formatted block, though?
18:03 jri joined #dataverse
18:30 jri joined #dataverse
19:11 pdurbin
it's all good :)
20:52 poikilotherm joined #dataverse
23:33 jri joined #dataverse
