Time
S
Nick
Message
02:43 icarito[m] joined #dataverse
03:58 nanoz joined #dataverse
04:35 icarito[m] joined #dataverse
05:03 jri joined #dataverse
07:51 nanoz joined #dataverse
07:57 jri joined #dataverse
10:51 poikilotherm joined #dataverse
13:27 isullivan joined #dataverse
13:51 nanoz joined #dataverse
14:01 poikilotherm
Morning gus :-)
14:01 poikilotherm
+
14:01 poikilotherm
y
14:02 pdurbin
Morning. Brian was here yesterday but all we talked about was Halloween costumes for dogs. Sorry.
14:02 poikilotherm
I read that :-D
14:03 poikilotherm
;-)
14:03 poikilotherm
No problem... Already added some comments to GH-5274 and hope for more replies... :-)
14:04 pdurbin
My sister in law's dog was way less convincing as a lion: https://i.imgur.com/I6iGxiA.jpg
14:05 pdurbin
poikilotherm: yeah, I spoke briefly with Matthew about it. All that stuff is in his head. He'll probably reach out to you soon.
14:07 pdurbin
I'm still dreaming about that 3.5 MB war file.
14:09 poikilotherm
Like my son would name it: ROOOOAR!
14:10 poikilotherm
Yeah sure, I'm working on it... :-D
14:10 poikilotherm
Had a pair programming meeting with my kubernetes colleague and he is all into getting his hands on the payara image based stuff
14:13 poikilotherm
We both are not very happy with the current approaches for OpenShift and what Slava did for DataverseEU. We both like images that are small and don't try to put everything inside an image (see openshift) and don't try to run the testdata etc installation (see dataverse-docker/dataversedock)
14:14 poikilotherm
This is all a very good source for inspiration and knowledge which knots to make and what knobs are needed :-)
14:29 donsizemore joined #dataverse
14:41 poikilotherm
Hey pdurbin, I'm wondering about a dependency you introduced:
14:41 poikilotherm
<dependency>
14:41 poikilotherm
<groupId>org.glassfish</groupId>
14:41 poikilotherm
<artifactId>javax.json</artifactId>
14:41 poikilotherm
<version>1.0.4</version>
14:41 poikilotherm
<scope>test</scope>
14:41 poikilotherm
</dependency>
14:42 pdurbin
me? :)
14:42 poikilotherm
JSON -P 1.0 is part of Java EE 8 and included in Payara 5. Nonetheless, the added dep provides JSON-P 1.1, but only during testing. Is that by design?
14:43 poikilotherm
The "p" is for Philip, right?
14:43 poikilotherm
:-D
14:43 poikilotherm
You added that for stubbing reasons, see 66dd604fafe57b8cb9402890713609521635c7a1
14:45 pdurbin
Yeah, you can call me Phil. Whatever.
14:45 pdurbin
ah, back in 2013. hmm
14:45 pdurbin
yeah, JSON -P should be included in Glassfish
14:45 pdurbin
should be safe to take out, I would hope
14:46 pdurbin
Oh, only during testing.
14:46 pdurbin
When we test we don't rely on Glassfish at all.
14:46 poikilotherm
The dep includes support for JCP-374 https://www.jcp.org/en/jsr/detail?id=374 , which is JSON -P 1.1
14:46 pdurbin
So maybe it has to be in there.
14:46 poikilotherm
Alright... Will look at that.
14:46 poikilotherm
Maybe this is no longer needed since Java 8
14:47 poikilotherm
Is "ellenk" still working with you?
14:47 pdurbin
Not sure. If anything, as you've pointed out, javax stuff is getting removed from Java.
14:47 pdurbin
Yeah, she's down the hall but she works on a different project.
14:47 poikilotherm
He/She introduced Gson to the codebase and I am wondering if this good to have Gson AND Jackson around...
14:47 poikilotherm
She
14:48 pdurbin
and javax.json
14:48 pdurbin
we have all the JSON libraries, I guess
14:48 poikilotherm
What was that about a smaller WAR footprint again? ;-)
14:48 pdurbin
you get javax.json out of the box with Java EE (Jakarta EE) so that's the one I think we should standardize on
14:48 pdurbin
kick out GSON and Jackson
14:49 poikilotherm
This is definitly part of Java EE 8
14:49 pdurbin
javax.json is part of Java EE 7 too. Maybe even Java EE 6.
14:49 poikilotherm
Sure. But the JSON -P stuff is EE 8 only ;-)
14:50 pdurbin
no, I don't think so
14:50 pdurbin
you're thinking about the JAXB for JSON stuff, perhaps. new with Java EE 8
14:50 pdurbin
b for binding
14:50 pdurbin
to entities
14:50 pdurbin
but for JSON rather than XML
14:51 poikilotherm
Oh you are right - JSON -P 1.1 is part of EE 8, JAXB / JSON-B is also new in 8
14:51 poikilotherm
JSON -P 1.0 was present before
14:53 pdurbin
yeah JSON -P 1.0 was JSR 353, included in Java EE 7: https://blogs.oracle.com/arungupta/java-ee-7:-key-features,-specifications,-projects,-mailing-list-archives ,
14:54 pdurbin
blue is "new in java ee 7": https://docs.oracle.com/javaee/7/tutorial/overview007.htm
14:56 poikilotherm
Wow... Google Guava is used in 6 places. Let me check how fat that JAR is
14:56 poikilotherm
2.2MB...
14:57 poikilotherm
Maybe I should start some cleanup first before trying to make special WAR moves?
14:58 poikilotherm
Top 20 libs after removing the big AWS dep:
14:58 poikilotherm
> du -hc target/dataverse-4.9.4/WEB-INF/lib/* | sort -h | head -n-1 | tail -n20
14:59 poikilotherm
1,5M target/dataverse-4.9.4/WEB-INF/lib/fontbox-2.0.11.jar
14:59 poikilotherm
1,6M target/dataverse-4.9.4/WEB-INF/lib/axis-1.4.jar
14:59 poikilotherm
1,6M target/dataverse-4.9.4/WEB-INF/lib/uimaj-core-2.9.0.jar
14:59 poikilotherm
1,7M target/dataverse-4.9.4/WEB-INF/lib/poi-ooxml-4.0.0.jar
14:59 poikilotherm
1,7M target/dataverse-4.9.4/WEB-INF/lib/solr-solrj-7.3.0.jar
14:59 poikilotherm
1,9M target/dataverse-4.9.4/WEB-INF/lib/jai_core-1.1.3.jar
14:59 poikilotherm
1,9M target/dataverse-4.9.4/WEB-INF/lib/jena-2.6.4.jar
14:59 poikilotherm
2,2M target/dataverse-4.9.4/WEB-INF/lib/commons-math3-3.6.1.jar
14:59 poikilotherm
2,2M target/dataverse-4.9.4/WEB-INF/lib/guava-16.0.1.jar
14:59 poikilotherm
2,5M target/dataverse-4.9.4/WEB-INF/lib/pdfbox-2.0.11.jar
14:59 poikilotherm
2,5M target/dataverse-4.9.4/WEB-INF/lib/xmlbeans-3.0.1.jar
14:59 poikilotherm
2,6M target/dataverse-4.9.4/WEB-INF/lib/poi-4.0.0.jar
14:59 poikilotherm
2,7M target/dataverse-4.9.4/WEB-INF/lib/xalan-2.7.0.jar
14:59 poikilotherm
3,1M target/dataverse-4.9.4/WEB-INF/lib/icu4j-3.4.4.jar
14:59 poikilotherm
4,0M target/dataverse-4.9.4/WEB-INF/lib/bcprov-jdk15on-1.60.jar
14:59 poikilotherm
4,0M target/dataverse-4.9.4/WEB-INF/lib/cdm-4.5.5.jar
14:59 poikilotherm
4,1M target/dataverse-4.9.4/WEB-INF/lib/primefaces-6.2.jar
14:59 poikilotherm
4,9M target/dataverse-4.9.4/WEB-INF/lib/grib-4.5.5.jar
14:59 poikilotherm
6,2M target/dataverse-4.9.4/WEB-INF/lib/poi-ooxml-schemas-4.0.0.jar
14:59 poikilotherm
8,6M target/dataverse-4.9.4/WEB-INF/lib/ehcache-2.10.1.jar
15:01 poikilotherm
Wow... Most of this is moved in as a dependency from tika
15:02 pdurbin
That was a recent addition.
15:02 pdurbin
It's a nice feature to be able to search PDFs and such. Thanks, Jim__ ! :)
15:02 poikilotherm
2015
15:02 poikilotherm
Ah sry Tika
15:02 poikilotherm
Yeah sure, tika is cool
15:02 poikilotherm
I just meant it will not be removable then
15:03 pdurbin
well, I think we're using all these deps
15:03 poikilotherm
Yeah, most likely :-/
15:04 poikilotherm
Well, with the exception of the Jackson/Gson stuff
15:09 poikilotherm
Hey at least it should be worth to take a look at the output of mvn dependency:analyse
15:09 poikilotherm
Maybe there are some leftovers that were not cleaned up when code changed
15:18 isullivan joined #dataverse
15:22 poikilotherm
I think I just found out why things magically worked with the aws bundle... https://github.com/IQSS/dataverse/issues/5274#issuecomment-436290141
15:23 donsizemore joined #dataverse
15:35 pdurbin
interesting
15:36 * poikilotherm
is currently using mvn enforcer:enforce to detect more dependency conflicts
15:36 poikilotherm
http://maven.apache.org/enforcer/maven-enforcer-plugin/
15:37 poikilotherm
And believe me... it's a long list...
15:39 pameyer joined #dataverse
15:40 pdurbin
No need to paste it in here. :)
15:40 poikilotherm
:-D
15:44 pameyer
poikilotherm: your idea about multi-stage builds is good for a reduction of ~ 500MB image size (at least in my hands, and when not trying to keep things small)
15:48 pdurbin
Huh. The Dataverse 4.0 war file was 45.2 MB . Compared to 146 MB for Dataverse 4.9.4.
15:52 poikilotherm
Cu later guys... Gotta go now.
16:12 pameyer
from the maven enforcer report, I don't know if I'm more suprised how many versions of jackson-databind are in there, or that there's one version that's included 2x
16:31 pdurbin
The community call starts in half an hour: https://dataverse.org/community-calls
18:00 jri joined #dataverse
18:42 donsizemore joined #dataverse
18:43 donsizemore
@pameyer @pdurbin Odum renamed its root dataverse to "unc" but did so before publishing. (i'm doing some web-stalking for Sherry)
18:53 pdurbin
tried to add a bit, thanks donsizemore
18:55 donsizemore
i'm a dummy but at least i try
19:01 pdurbin
hopefully the combo of information helps
19:05 pameyer
I hadn't known there was a `:root` thing you could use with the APIs
19:06 pdurbin
Michael's the one who sprinkled colons everywhere before we shipped 4.0.
19:07 pdurbin
To him a colon means something but I forget what.
19:08 pameyer
well, the `:persistentId/?persistentId=$foo` pattern is definately high up in my list of API non-intiutiveness ;)
19:08 pdurbin
yeah
19:09 pdurbin
:publish
19:09 pdurbin
etc
19:11 pameyer
https://github.com/IQSS/dataverse/issues/3427 reminded me of some other non-intuitiveness. the "use these blocks" checkboxes in the UI have no effect on what blocks the API is allowed to use
19:13 pameyer
it was fortunate in my case - I'd forgotten to add a set the new block in my configs, API tests went fine. go to look at it in the UI create page, and got surprised that it wasn't there ...
19:13 pdurbin
We estimated that one the other day when I brought it up. It got a 3.
19:14 pdurbin
Huh, it's at the top of "Ready". Cool.
19:14 pdurbin
donsizemore: no promises though
19:34 pdurbin
The DVN 3.6.2 war file was only 43.3 MB .
19:35 pameyer
I few weeks back the ops repo I was using for dataverse configs hit the 2G size limit, because I'd been checking in versions of dvinstall.zip that were known to work with the configs
19:38 pdurbin
yikes
20:26 jri joined #dataverse
21:32 donsizemore joined #dataverse
