IQSS logo

IRC log for #dvn, 2014-04-15

We've moved! Please join #dataverse instead. The new logs are at http://irclog.iq.harvard.edu/dataverse/today

| Channels | #dvn index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
01:10 garnett joined #dvn
04:40 garnett joined #dvn
07:58 bencomp joined #dvn
11:10 bencomp joined #dvn
12:31 skay pdurbin: hi, I'm still busy at pycon, but I had some questions about the api metrics.
12:32 skay pdurbin: is it the case that your java code uses a monitoring library?
12:32 skay pdurbin: if so, then you would instrument your api handling code to fire monitoring events.
12:33 skay you will lkely want to be monitoring your transactions anyway, so this is good
12:35 skay pdurbin: also, won't clients need to authenticate and identify their rquests similar to how clients of other services do these things (analogy: aws requests) so this is also a way to track origin of incoming requests
12:38 skay pdurbin: back to monitoring. my background when working in java was to use a library developed at orbitz called erma, which submited events via streambase to graphite. I think I mentioned this before, apologies for repeating myself
12:39 skay pdurbin: we wanted to move away from streambase and use something like statsd instead. so if you are starting from scratch, I recommend surveying what people are using
12:39 pdurbin no, I'm not using a monitoring library
12:39 skay pdurbin: to sum up. I am telling you to instrument your java code so that it fires event monitors and transaction monitors to a service like graphite.
12:40 * pdurbin has heard good things about graphite
12:40 skay pdurbin: okay, to fall back from that, you can even do some good log scraping and then number crunch from there
12:40 skay even if just log scraping apache access logs. but I am guessing you use something like log4j or whatever
12:40 pdurbin yeah, I'd rather build metrics gathering into the app
12:41 pdurbin if it's a design requirement
12:41 skay yeah, that is a much better thing
12:42 pdurbin skay: have you found any OSF people at pycon?
12:42 skay pdurbin: yes, but I've been running around. I should probably find them today and talk more
12:44 skay pdurbin: if I don't have a good block of time to review the python client, then I think they should just merge and not let me hold them up
12:46 pdurbin skay: maybe talk with them about the merge in person if you can
12:47 skay pdurbin: that will be my goal, along with also talking about the api for depositing
12:48 skay pdurbin: I'm leavng Montreal tomorrow so I better find everyone today!
12:49 pdurbin skay: nice. are you in Montreal for long?
12:49 skay pdurbin: not much longer. I came in on the 10th for the conference and stayed these two days for sprints
12:50 skay sprints go for another day but flights on Thursday were almost 2x as much!
12:51 skay pdurbin: maybe for next pycon I could bracket it with some vacation
12:52 skay ttyl, to the sprint rooms I go
12:53 pdurbin o/
12:53 pdurbin skay: thanks for your feedback on the metrics thing
13:12 JonathanNeal joined #dvn
14:50 garnett joined #dvn
16:23 axfelix joined #dvn
19:31 axfelix joined #dvn
21:27 iqlogbot joined #dvn
21:27 Topic for #dvn is now http://thedata.org - The Dataverse Network Project | logs at http://irclog.iq.harvard.edu/dvn/today
21:37 axfelix joined #dvn
21:38 garnett joined #dvn

| Channels | #dvn index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

We've moved! Please join #dataverse instead. The new logs are at http://irclog.iq.harvard.edu/dataverse/today