IRC log for #dataverse, 2015-10-14

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.

All times shown according to UTC.

Time	Nick	Message
05:09		axfelix joined #dataverse
05:09		axfelix joined #dataverse
07:45		bencomp joined #dataverse
08:37		sivoais joined #dataverse
08:47		sivoais joined #dataverse
08:57		sivoais joined #dataverse
09:07		sivoais joined #dataverse
09:18		sivoais joined #dataverse
09:28		sivoais joined #dataverse
09:38		sivoais joined #dataverse
09:49		sivoais joined #dataverse
09:59		sivoais joined #dataverse
10:09		sivoais joined #dataverse
10:20		sivoais joined #dataverse
10:30		sivoais joined #dataverse
10:40		sivoais joined #dataverse
10:48	pdurbin	bencomp: saw your comment. Did you see that Glassfish can give monitoring output as JSON? https://github.com/IQSS/dataverse/issues/2595#issuecomment-147800081
10:50		sivoais joined #dataverse
11:00		sivoais joined #dataverse
11:15	bencomp	pdurbin: I did :)
11:15	bencomp	but I didn't try to get more data from your production environment because I know it won't work
11:23	pdurbin	bencomp: what do you think I should measure from that output? For now I'm planning on measuring three things (numconnused, connrequestwaittime, numconnacquired): http://danceb.in/PgsNzGVy5RGig92zDMIysQ/raw
11:24	pdurbin	I'm also wondering where to put this data. It would be nice if we had http://ganglia.info or similar setup.
11:25	bencomp	pdurbin: we have nagios
11:26	pdurbin	bencomp: do you collect "performance data" or whatever they call it? Can you add your own metrics and graph it over time?
11:27	bencomp	of course it's up to your ops team to know (through discussion with dev) what they need to know and monitor
11:27	bencomp	I haven't sat down with our ops to go into details
11:28	bencomp	I think I mentioned before that we monitor disk usage and http status for homepage, plus resolving some handle(s)
11:28	bencomp	probably cpu and memory too
11:32	pdurbin	bencomp: sure. I'm planning on putting a cleaned up version of that script on https://apitest.dataverse.org (which I control). It just writes the metrics to tsv files but it would be nice to put them into a system built for collecting monitoring data.
11:36	bencomp	pdurbin: your script has too much file handling
11:37	bencomp	there are libraries for logging
11:38	pdurbin	bencomp: if you want credit for improving it you can wait until I've pushed it. :) might be time for another pull request :)
11:39	bencomp	I planned to answer Gustavo today and maybe rebase my previous pull requests
11:39	bencomp	Wikimedia has 29337 CPUs :O
11:40	bencomp	http://ganglia.wikimedia.org/latest/
12:36	pdurbin	bencomp: the root problem of developers not even being aware they're using raw types isn't solved (I don't think)
12:37	bencomp	:(
12:37	pdurbin	so the code will revert to raw types over time
12:38	pdurbin	unless we solve that problem
12:42	pdurbin	this is quite interesting: https://confluence.ucop.edu/display/Stash/About#About-StashFunctionalArchitecture
12:42	pdurbin	https://github.com/CDLUC3/dashv2
13:45	pdurbin	oh, cool. connrequestwaittime moved a bit
14:00	pdurbin	starting to collect data at https://apitest.dataverse.org/guides/developers/issues/2595/index.html
14:02	pdurbin	here's my script: https://github.com/IQSS/dataverse/commit/922e9f5
14:06	pdurbin	bencomp: now you're welcome to code review it :)
14:06	pdurbin	meanwhile I'm going to send it to our ops team
14:24	pdurbin	actually, I wrote a summary first: https://github.com/IQSS/dataverse/issues/2595#issuecomment-148065637
14:24	pdurbin	bencomp: thanks for pointing out the wikipedia ganglia instance. I linked to it
15:01		metamattj joined #dataverse
15:10		axfelix joined #dataverse
16:36	bencomp	https://backstage.forgerock.com/#!/docs/openam/12.0.0/deployment-planning -> now that is a deployment planning document...
16:37	bencomp	I'm not sure the Dataverse installation guide can match that ;)
16:38	bencomp	pdurbin: if your script works, it's fine
16:56	bencomp	pdurbin left the room?!
16:59		metamattj joined #dataverse
17:08		pdurbin joined #dataverse
17:10		metamattj joined #dataverse
17:55		cnk joined #dataverse
19:16		bencomp joined #dataverse
19:40		axfelix joined #dataverse
19:50		bencomp1 joined #dataverse

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.