Time
S
Nick
Message
03:29 axfelix joined #dataverse
03:30 axfelix joined #dataverse
04:09 axfelix joined #dataverse
05:24 axfelix joined #dataverse
06:25 djbrooke joined #dataverse
08:18 jri joined #dataverse
13:02 djbrooke joined #dataverse
13:34 donsizemore joined #dataverse
13:57 andrewSC joined #dataverse
13:57 andrewSC
morning all
13:57 pdurbin
mornin
14:34 djbrooke joined #dataverse
14:42 djbrooke joined #dataverse
14:45 djbrooke_ joined #dataverse
14:53 pameyer joined #dataverse
14:54 donsizemore joined #dataverse
14:57 pdurbin
donsizemore: mornin'. Did you see this? https://groups.google.com/d/msg/dataverse-community/obUKSqR4GRA/4_obrxb5EgAJ
14:58 donsizemore
@pdurbin Happy New Year! I saw the postings but assumed I was waiting on the next release. Lucy gonna have some upgradin' to do?
14:59 pdurbin
Lucy? :)
14:59 pdurbin
the pull request is still in code review
15:50 djbrooke joined #dataverse
15:58 djbrooke joined #dataverse
16:01 djbrooke joined #dataverse
16:13 andrewSC
can you guys think of why a file upload to a dataset might hang or not complete?
16:14 andrewSC
doesn't seem to be anything in the logs
16:16 djbrooke joined #dataverse
16:18 andrewSC
seems like it can handle smaller files fine but anything past a mb it freezes up
16:37 pameyer
andrewSC: what type of files?
16:37 andrewSC
tried a 1.2mb pdf
16:37 andrewSC
then a 9.4mb jpg
16:37 andrewSC
i added -Ddataverse.dataAccess.thumbnail.pdf.limit=300000 per https://github.com/IQSS/dataverse/issues/2482
16:38 andrewSC
just restarted glassfish
16:38 andrewSC
gonna see if that fixes it
16:38 pameyer
it might be worth watching the cpu load on the server - if that's high, it'll probably be dataverse ingest-related
16:39 pameyer
if not, it might be something else (apache/lighttpd/nginx if you've got one of those in front of glassfish)
16:39 andrewSC
hmmmmmm
16:39 andrewSC
yeah that didn't seem to fix it
16:39 andrewSC
cpu load seems good though
16:40 pdurbin
andrewSC: should work. Very strange.
16:41 andrewSC
yeah the 1.2mb pdf upload has a full bar but never resolves to complete
16:41 andrewSC
seems like it's hanging or something
16:42 pdurbin
What version of Dataverse?
16:42 andrewSC
oh wait
16:42 andrewSC
uhh
16:42 andrewSC
4.3.1
16:42 andrewSC
just popped open dev console on chrome and it looks like i got a 413 on the upload
16:42 andrewSC
hmmmmmmm
16:43 andrewSC
looking at the installation guide it seems like nothing is recommended to sit infront of glassfish? (I unfortunately didn't set this system up)
16:44 pdurbin
Do you get the same error code if you upload via SWORD?
16:44 andrewSC
hmm haven't tried that yet lemme see
16:47 pameyer
https://en.wikipedia.org/wiki/List_of_HTTP_status_codes: 413 is probably web server related
16:47 andrewSC
right right
16:47 pameyer
it's usually configurable
16:48 andrewSC
i don't know what the webserver is though/if glassfish *is* the webserver?
16:50 pameyer
which port are you accessing?
16:50 pameyer
it may not be definative (depends on the system config)
16:50 pameyer
but it'll give a little more info
16:51 andrewSC
seems like 8080
16:51 andrewSC
actually wait
16:51 andrewSC
i'm behind a proxy
16:51 andrewSC
let me try this without the proxy
16:53 andrewSC
pameyer: that was it
16:53 andrewSC
gonna open a ticket with IT about the proxy
16:53 andrewSC
wew lad that one could have got me pretty good lol
16:54 pdurbin
What kind of proxy are you using?
16:55 djbrooke joined #dataverse
16:56 andrewSC
pdurbin: it's some sort of webserver that forwards requests after you've auth'd with shib
16:56 andrewSC
another team runs it--it just lets us expose certain services we've setup internally to other members within ncsu
16:58 pdurbin
huh, ok
17:00 andrewSC
yeahhhh lol
17:00 andrewSC
we're currently in the process of transitioning to AWS so the quirks should go away shortly
17:00 andrewSC
:)
17:01 pdurbin
ah, I wonder if you'd be interested in https://github.com/IQSS/dataverse-aws by telnoratti
17:02 andrewSC
heck. yes.
17:02 djbrooke joined #dataverse
17:02 andrewSC
I was going to look around at docker stuff for dataverse later today but you beat me to the punch lol
17:29 djbrooke joined #dataverse
17:44 djbrooke joined #dataverse
18:00 donsizemore joined #dataverse
18:29 djbrooke joined #dataverse
18:44 djbrooke joined #dataverse
18:58 djbrooke joined #dataverse
19:25 donsizemore joined #dataverse
19:29 bjonnh
andrewSC: I am working on a slightly different way of dockerizing dataverse
19:29 bjonnh
andrewSC: especially for dev and testing purpose
19:29 bjonnh
andrewSC: absolutelly not meant for production
19:30 bjonnh
andrewSC: pdurbin kind of want a way to test specific tags/versions of dataverse
19:31 bjonnh
andrewSC: and I wanted to be able to develop easily new features in a locally working datavarse install
19:31 bjonnh
andrewSC: do you have specific needs?
19:32 pameyer
bjonnh: out of curiosity, how are you handling the asadmin during installation?
19:32 pameyer
copying domain.xml after customization, or commands in the container generation?
19:35 bjonnh
you mean the glassfish thing?
19:35 pameyer
yup
19:35 bjonnh
sh -c "$GLASSFISH_USER_HOME/glassfish4/bin/asadmin start-domain domain1"
19:35 bjonnh
running as $GLASSFISH_USER
19:36 bjonnh
don't think I touch domain.xml
19:36 bjonnh
let me check
19:37 bjonnh
oh I use the same scripts as the vagrant deploy
19:37 bjonnh
if that's what you mean
19:37 pameyer
ok - that makes sense
19:37 pameyer
thanks
19:37 bjonnh
slightly modified for now (I'm using the non solr version)
19:38 bjonnh
I would like to merge everything in a single script that works both for vagrant and docker
19:38 bjonnh
that would avoid maintaining two versions
19:38 jeffspies______ joined #dataverse
19:38 pameyer
I've had semi-reasonable luck using ansible to configure vagrant and docker (although not directly for dataverse)
19:40 bjonnh
I prefer to use a direct docker approach, as having to use ansible implies that you have ssh in a container
19:40 bjonnh
but that's a good idea
19:41 pameyer
RUN ansible-playbook -i local.hostlist -c local defs.yml
19:41 bjonnh
that would be even better in that case
19:41 bjonnh
yeah that's what I was thinking
19:41 bjonnh
that would actually remove the need for complex scripts
19:41 bjonnh
and would allow to do quick redeploy
19:41 pameyer
in that case, I had existing ansible that I was using for both vagrant and production deployment; and wanted to see if I could dockerize it without a rewrite
19:41 bjonnh
and also it would make it provider agnostic
19:42 bjonnh
everybody loves aws now, but not sure it will still be the case 2 years from now
19:42 bjonnh
(same for docker)
19:43 pameyer
agreed
20:29 djbrooke joined #dataverse
20:46 pdurbin
bjonnh: yes, thanks for remembering
21:04 djbrooke joined #dataverse
22:55 djbrooke joined #dataverse
22:56 djbrooke_ joined #dataverse
22:57 djbrooke joined #dataverse
23:00 djbrooke_ joined #dataverse
23:22 djbrooke joined #dataverse
