IQSS logo

IRC log for #dataverse, 2016-10-28

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
00:26 sivoais joined #dataverse
02:09 djbrooke joined #dataverse
02:48 bjonnh is anyone aware of any project to document 96 well plates?
03:06 djbrooke joined #dataverse
10:54 pdurbin bjonnh: are you trying to inventory what's in the wells? Or are you storing assay data? Or something else? (Hat tip to my wife for telling me what to ask!)
10:55 pdurbin She's the one who's always playing God: https://twitter.com/philipdurbin/status/664645552353755136
11:50 djbrooke joined #dataverse
12:04 donsizemore joined #dataverse
13:08 bjonnh pdurbin: both
13:11 bjonnh I wanted to make something that allows to export a JSONish description of the plate to svg/html/so on
13:11 bjonnh and manipulate it
13:11 pdurbin bjonnh: I believe what you're looking for is called an electronic lab notebook (ELN) or a laboratory information management system (LIMS).
13:11 bjonnh pdurbin: so God is using android… :p
13:11 bjonnh pdurbin: yes but no ;)
13:12 bjonnh pdurbin: I want a simple system that you can connect to other things easily
13:12 bjonnh not a big mammuth
13:12 pdurbin pameyer: know any biologists or biochemists?
13:13 bjonnh especially something that could be integrated with systems such as isatools
13:13 pdurbin bjonnh: my wife suggested using Excel for starters
13:13 bjonnh easily in websites
13:13 bjonnh pdurbin: yeah I know that, that's exactly what I want to move people from
13:13 bjonnh :p
13:14 pdurbin heh
13:14 bjonnh Sorry I was not clear enough :p
13:14 pdurbin bjonnh: have you ever heard of ResearchSpace or RSpace? https://github.com/IQSS/dataverse/blob/71b2c33b1261691a839fbb6b13f2c9970feb245e/doc/sphinx-guides/source/api/client-libraries.rst#java
13:16 bjonnh pdurbin: I'm more talking low level
13:16 bjonnh pdurbin: format/protocol, manipulation and then visualization
13:17 bjonnh Also, I want people to still be able to use their data in some years from now
13:18 bjonnh my problem is exactly all those ELN systems
13:18 bjonnh with all their different formats, different approaches, different protocols
13:19 bjonnh (note: my job is partly to make ontologies)
13:21 pdurbin bjonnh: but wouldn't the goal be to have Dataverse and RSpace (or whatever ELN or LIMS) use the same ontology and formats?
13:22 bjonnh yes
13:23 bjonnh I need to see if displaying plates on dataverse would be useful though
13:23 bjonnh not sure people are still using plate-level data at that point
13:24 pdurbin what level are they using?
13:24 bjonnh I see mostly lists
13:24 bjonnh but I'm biased
13:25 bjonnh that's part of my project to look in a more statistically relevant way
13:25 pdurbin is any of what you're looking at public?
13:26 bjonnh well there aren't plenty
13:27 bjonnh let me find one
13:28 bjonnh if I can
13:32 bjonnh ok so maybe I can't see one in dataverse
13:33 pdurbin bjonnh: go ahead and upload something :)
13:33 bjonnh well
13:33 bjonnh that's the plan at some point
13:33 bjonnh :p
13:34 bjonnh but what people do usually is that they convert the rectangular format to a list format
13:39 bjonnh If I was dishonest I would say that this explain why what I want to do is important ;)
13:39 bjonnh because people cannot do it easily :p
13:41 pdurbin bjonnh: maybe for now you could just upload it to https://demo.dataverse.org
13:42 bjonnh I don't have data I can upload right now
13:42 bjonnh not mine
13:42 bjonnh at least
13:42 pdurbin oh, bummer
13:42 pdurbin It's hard to know what you're talking about then.
13:42 bjonnh yes
13:42 bjonnh I'm trying to find an open dataset somewhere else
13:43 pdurbin ah, good
13:45 bjonnh but it is hard to find
13:45 bjonnh because most of the time people reduce the data to results
13:46 bjonnh raw plate data is usually not published
13:46 bjonnh pdurbin: http://dev.lincs.hms.harvard.edu/wordpress/wp-content/uploads/2011/11/HMS-LINCS-ISA-Tab-201111181-e1441295598409.png
13:47 pdurbin oh! LINCS!
13:47 pdurbin pameyer: we've heard of them!
13:49 bjonnh pdurbin: so many projects out there
13:50 djbrooke joined #dataverse
13:51 djbrooke joined #dataverse
13:52 djbrooke_ joined #dataverse
13:52 pdurbin bjonnh: please check out the "Biomedical Dataverse: Datasets from the NIH LINCS Project" slides at http://projects.iq.harvard.edu/files/dcm2016/files/shamu_dataversemtg_7-11-16_copy.pptx by Caroline Shamu from http://projects.iq.harvard.edu/dcm2016/meeting-agenda
13:55 bjonnh https://www3.appliedbiosystems.com/cms/groups/mcb_marketing/documents/generaldocuments/cms_039767.pdf
13:56 bjonnh most machine software update data as a CSV file
13:56 bjonnh with
13:56 bjonnh A1, 0.1
13:56 bjonnh A2, 0.3
13:56 bjonnh etc
13:56 bjonnh (can output many more values)
13:56 pdurbin ok, are those slides helpful?
13:57 bjonnh well they don't talk about the well-format to treated format
13:58 pdurbin bjonnh: I think we should start with your real world data.
13:59 bjonnh well that's the thing
13:59 pdurbin without a user story...
14:00 bjonnh we have to make well plans (for now it is a Spreadsheet that look like the last pdf I sent)
14:00 bjonnh each well has a lot of data associated
14:01 bjonnh I'll try to get an anonimized dataset from this person
14:02 pdurbin bjonnh: perfect! Thanks!
14:02 bjonnh https://github.com/craic/plate_maps
14:03 bjonnh https://github.com/craic/plate_maps/blob/master/test/data/map_one_plate_384.csv
14:03 bjonnh that's one of the data type
14:03 bjonnh that associates sample name to physical position in the plate
14:04 bjonnh then you obtain one or more results by well in a format similar to what you see here: https://qbrc.swmed.edu/download/SbacHTS_Manual.pdf
14:08 pdurbin cool but where is the cvs with the T1Raw, T2Raw, T3Raw values?
14:09 bjonnh what do you mean?
14:10 pdurbin from that last pdf, the actual data
14:10 pdurbin that biochemists care about
14:11 bjonnh there are many
14:11 bjonnh the output values are of many different type
14:11 bjonnh and dimensions
14:12 bjonnh sometimes reference to picture or videos, sometimes one float, sometimes hundreds of dimensions
14:12 bjonnh there is no "one format" nor "one standard"
14:13 bjonnh most of the time produced by machines, but sometimes by humans (visual analysis)
14:14 bjonnh so instead of creating yet another format for describing what we are doing in the lab, I wanted to make something generic
14:14 bjonnh that can be reused
14:15 pdurbin cool
14:15 pdurbin it sounds like a worthy project
14:15 bjonnh maybe, I have to finish my study of what is existing first
14:16 pdurbin I think the only way I can help is by getting you in touch with the RSpaces and researchers I know. I've invited some folks to read these logs and jump in. :)
14:16 bjonnh great, thanks
14:17 bjonnh pdurbin: https://upload.wikimedia.org/wikipedia/commons/5/5e/Microplates.jpg
14:17 bjonnh I don't know if you have seen what it looks like in real
14:18 pdurbin I've been to my wife's lab before. :)
14:19 bjonnh what is she doing?
14:20 pdurbin https://www.linkedin.com/in/teresa-broering-2464242
14:21 bjonnh by the way did I told you that my lab now requires mandatory dataverse deposit of data involved in publications?
14:22 bjonnh neat
14:22 bjonnh pdurbin: I suppose they are using ELN in her lab?
14:23 pdurbin yeah, it's in that tweet. Benchling
14:23 pdurbin the big news is that the FDA just approved her first drug: http://www.mercknewsroom.com/news-release/corporate-news/fda-approves-mercks-zinplava-bezlotoxumab-reduce-recurrence-clostridium-
14:24 bjonnh oh I was thinking it was just a plasmid maker
14:24 bjonnh oh congrats then !
14:26 pdurbin thanks, I'll pass it along. I already showed pameyer the PDB entry: http://www.rcsb.org/pdb/explore.do?structureId=4NP4 :)
14:32 donsizemore joined #dataverse
14:34 pameyer bjonnh - sorry I'm a bit late to the conversation.  it's sounding like you've got a mix of input formats for the plates (aka - sometimes instrument, sometimes experimenter/analysis tool/visualization tool).
15:58 rob-researchspac joined #dataverse
16:00 jhand joined #dataverse
16:02 dataverse-user joined #dataverse
16:03 rob-researchspac joined #dataverse
16:05 pdurbin rob-researchspac: hi! welcome!
16:06 rob-researchspac RSpace uses totally standard formats: pdf, html and xml. Pdurbin, One click export would make it very easy to get your plate data out. Export to dataverse is already built in. You can try it free at community.researchspace.com or I can give you a live demo to show you how easy it would be to use with 96 well plate data.
16:06 rob-researchspac Its a really simple system
16:07 pdurbin rob-researchspac: do you have public examples of plate data already?
16:07 rob-researchspac email me if you like and I'll give you a webcast demo right now if you are available. rob@researchspace.com
16:08 pdurbin rob-researchspac: sorry, I'm kind of heads down in fixing bugs for pameyer but maybe bjonnh would like a demo
16:11 rob-researchspac Anyone here is welcome to contact me
16:13 pdurbin rob-researchspac: much appreciated! And you're saying the integration with Dataverse is already live?
16:16 rob-researchspac joined #dataverse
16:18 rob-researchspac dataverse integration is technically in advanced prototype stage, but will be available for all users with next release. RSpace is evolving at very fast pace, with new releases and features every month.
16:21 pdurbin rob-researchspac: is sign in via Google working? I just got this: Signin could not complete: Status:500 - server error There was an error responding to this request, which has been logged. Something went wrong: No account found for email philipdurbin@gmail.com, please sign up
16:23 karissa joined #dataverse
16:34 rob-researchspac I think you need to create an account first and list a gmail address as your official email for that account, THEN you can subsequently login with google
16:35 rob-researchspac ah, nope, that's not true! you can just use whatever google account you are currently logged in with
16:36 rob-researchspac I just tested it ... it works fine even for a totally new google accont
16:36 rob-researchspac no "pre-register" is needed.
16:36 rob-researchspac I suggest rechecking your google credentials,
16:38 pdurbin rob-researchspac: I get the same thing for a different google account: "Something went wrong: No account found for email pdurbin@g.harvard.edu, please sign up". Don't worry about it. Maybe I'll create a local account some day but probably not today.
16:38 rob-researchspac so... you have TWO login options.... you can manually make a new account with any email address you like, OR just click "login with google" and it will create a new account for you based on whatever google ID your browser is currently using.
16:43 pdurbin ok
16:45 bjonnh joined #dataverse
16:46 skay joined #dataverse
16:50 pdurbin karissa: hi! Welcome! Did you catch some of the chatter at https://botbot.me/freenode/dat/msg/75629136/ ?
16:50 pdurbin chatter with jhand. Welcome to you too! :)
17:17 donsizemore joined #dataverse
17:22 djbrooke joined #dataverse
17:39 djbrooke joined #dataverse
17:39 bret joined #dataverse
18:30 bjonnh pameyer: yep
18:30 bjonnh oh rob left
18:32 pameyer I'm guessing there aren't format standards for "put complex, possibly structured, data into a 2d grid"
18:43 bjonnh so I may have to make one
18:43 bjonnh but that's what I'm trying to figure out
18:43 bjonnh if I need to make one or if something akin to it exist
18:45 pameyer I haven't done much w\ 96 well plates for a few years, and then it was liquid handling robots instead of experimental measurements.  but there wasn't anything standardized then
18:45 djbrooke joined #dataverse
19:41 djbrooke joined #dataverse
19:41 pdurbin mmm, robots
19:42 pdurbin jhand: nice presentation! I'm looking forward to your follow up talk on Monday! http://www.iq.harvard.edu/event/tots-tip-4
19:42 pdurbin pameyer: you should come to this. It has DCM and DLM written all over it
19:46 djbrooke joined #dataverse
19:50 djbrooke joined #dataverse
19:54 pameyer pdurbin: the tots-tip thing?
19:55 pameyer DATS has come up across my radar a few times; if things aren't too crazy I'll try to make it
19:57 pdurbin pameyer: cool. and it's just "Dat"
19:57 pdurbin pameyer: I'm gonna show jhand https://data.sbgrid.org
19:57 pameyer cool
19:58 pameyer pdurbin (/jhand) : do you have a link for "Dat"?
19:58 pameyer nm - found it
19:59 pameyer I'll be back in a bit (if there are data.sbgrid.org questions I should field)
20:03 pdurbin pameyer: I should know this but is the DLM powered by rsync?
20:11 djbrooke joined #dataverse
20:13 djbrooke joined #dataverse
20:14 djbrooke joined #dataverse
20:17 djbrooke joined #dataverse
20:22 jhand pameyer: hopefully I'll see you Monday. Happy to answer any questions in meantime, I'm in here or in #dat.
20:28 djbrooke joined #dataverse
20:34 djbrooke joined #dataverse
20:38 djbrooke joined #dataverse
20:45 djbrooke joined #dataverse
21:34 djbrooke joined #dataverse

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.