Time
S
Nick
Message
01:08 djbrooke joined #dataverse
04:41 axfelix joined #dataverse
07:20 jri joined #dataverse
08:16 djbrooke joined #dataverse
12:08 donsizemore joined #dataverse
12:23 dls joined #dataverse
14:10 djbrooke joined #dataverse
14:24 djbrooke joined #dataverse
14:37 djbrooke_ joined #dataverse
14:40 nicholas_ joined #dataverse
14:41 djbrooke joined #dataverse
14:43 djbrooke joined #dataverse
14:45 dls joined #dataverse
14:48 donsizemore joined #dataverse
14:49 djbrooke joined #dataverse
15:02 djbrooke joined #dataverse
15:32 djbrooke joined #dataverse
16:03 djbrooke joined #dataverse
16:22 djbrooke_ joined #dataverse
16:24 pvh_sa joined #dataverse
16:25 pvh_sa
hi pdurbin... I see donsizemore isn't online right now.
16:38 donsizemore joined #dataverse
16:39 djbrooke joined #dataverse
16:44 pdurbin
donsizemore: knock knock ^^
16:45 pdurbin
pvh_sa: had a question about iRODs: https://gitter.im/mozillascience/community/archives/2016/09/16
16:48 donsizemore
@pvh_sa i'm happy to answer any questions i can, but you really want to talk to Akio Sone, asone
16:49 donsizemore
@pvh_sa for a small-scale installation you might check out iRODS-webdav http://irods.org/2015/04/how-to-drag-and-drop-access-to-irods-with-webdav/ (and for a Linux client, say davfs2)
16:50 donsizemore
@pvh_sa what we'd really want is a dataverse interface to iCommands, but either way you're looking at caching problems at scale
17:03 pvh_sa
donsizemore, caching problems how? we're basically looking into building a system for uploading and storing data long term to a store (iRODS is preferred here)
17:03 pvh_sa
for certain data types / user groups we'll enforce a metadata capture interface to ensure we have a standard set of metadata for e.g. incoming DNA sequencing samples
17:04 pvh_sa
then export from there to Galaxy for running analyses... store long term valuable results in iRODS again (and Neo4j DBs, but that's another story)
17:05 pvh_sa
we = SANBI (bioinformatics institute in South Africa)
17:05 donsizemore
@pvh_sa everything we tried up front on this end involved a davfs2 mount (which caches everything locally)
17:06 donsizemore
@pvh_sa you could also check out irods-cloud-browser though i'd imagine what you really want is an application interface to icommands
17:07 pvh_sa
donsizemore, yeah some of our colleagues been working on something like that. the python bindings need a bit of TLC though, which is a pity since we like python
17:08 pvh_sa
on the dataverse side though... I had a look at your DataFileIO interface... is that the main dataverse storage interface?
17:15 pdurbin
pvh_sa: yes, from what I understand
17:16 pvh_sa
so where does dataverse store metadata then?
17:16 pvh_sa
because DataFileIO is concerned with files, URLs... data, not metadata...
17:23 donsizemore
@pvh_sa i believe dataverse keeps all its metadata in postgres.
17:24 pdurbin
right, metadata goes in postgres: http://phoenix.dataverse.org/schemaspy/latest/tables/datasetfield.html
17:36 pdurbin
pvh_sa: if you would like a better answer, please email https://groups.google.com/forum/#!forum/dataverse-dev to reach other developers who know more about this area of the code
17:38 pvh_sa
thanks pdurbin ... its enough for now... its always interesting looking at projects to see how they do things, get ideas.
17:38 pdurbin
yeah
17:39 pdurbin
please send more ideas :)
18:09 mconway joined #dataverse
18:09 mconway42 joined #dataverse
18:10 mconway42
hey pvh. It's Mike Conway at UNC, I'm a friend of Don Sizemore, I can perhaps help you with some of your q's alongside don and akio, if you all want to touch base maybe next week michael_conway
18:32 djbrooke_ joined #dataverse
18:36 pdurbin
pvh_sa: did you see that message from mconway42? ^^
18:44 djbrooke joined #dataverse
18:56 pvh_sa
thanks mconway42 - going to be meeting with my team (local and remote) on Monday... will collate questions
19:04 djbrooke joined #dataverse
19:13 djbrooke joined #dataverse
19:24 djbrooke joined #dataverse
19:36 djbrooke joined #dataverse
20:10 djbrooke joined #dataverse
20:20 djbrooke joined #dataverse
20:22 sivoais joined #dataverse
20:29 djbrooke_ joined #dataverse
21:03 djbrooke joined #dataverse
21:32 sivoais joined #dataverse
22:29 djbrooke joined #dataverse
23:23 djbrooke joined #dataverse
