Time
S
Nick
Message
03:36 axfelix joined #dataverse
04:06 djbrooke joined #dataverse
06:43 djbrooke joined #dataverse
07:25 jri joined #dataverse
08:14 majest1c joined #dataverse
08:31 romainM joined #dataverse
10:01 jri joined #dataverse
12:29 donsizemore joined #dataverse
12:41 dataverse-user joined #dataverse
12:41 dataverse-user left #dataverse
12:43 romainM
pdurbin: Hi ! I wanted to know if there was any news about a possible Piwik Analytics addition to Dataverse ?
12:44 romainM
jri, our admin sys, made a github issue+pull request for it here : https://github.com/IQSS/dataverse/issues/3018
12:45 romainM
given that it's been some times that I was discussed, I wanted to know if there was any hidden talks/news about that ?
12:45 romainM
*that it was discussed
12:45 pdurbin
romainM: I see the issue but what is the pull request number, please?
12:46 romainM
looking for it
12:46 pdurbin
(I'm not sure a pull request has been made yet.)
12:46 romainM
oh, maybe not pull request
12:46 romainM
but commits
12:46 romainM
he may have asked for opinions first
12:46 pdurbin
yeah, I left comments on the commits back in March
12:46 romainM
I'm reading comments right now
12:48 romainM
didn't read all before posting, sorry
12:48 romainM
but I see that some "questions" had to be asked about it
12:49 romainM
anything about it ?
12:50 pdurbin
well, our designer and QA person should look at it, at least, but I believe they are busy with other things at the moment
12:51 pdurbin
romainM: would you or jri be able to help them get set up to run the code if they have time to look at it?
12:52 romainM
myself, I haven't dealed with piwik personnally, except adding some html in some of our websites
12:52 romainM
maybe jri could, I'll see him in a few minutes
12:53 romainM
but if I can help for that, I'll try anyway :)
12:53 pdurbin
romainM: do you think your or jri would be able to call in and explain the issue (and future pull request)? The dial in numbers and dates are at http://dataverse.org/community-calls
12:54 donsizemore joined #dataverse
12:56 romainM
hum
12:56 romainM
got a doubt
12:56 romainM
for the date
12:56 romainM
I'll have to discuss it with him
13:00 pdurbin
romainM: https://waffle.io/IQSS/dataverse shows what is actively being worked on and https://github.com/IQSS/dataverse/issues/3018 is one of 809 issues in the "Backlog" column.
13:04 pdurbin
romainM: does that make sense? I'm just trying to explain what is on our radar right now and what isn't.
13:04 romainM
yeah
13:04 romainM
I just tought "backlog" was "everything else"
13:05 pdurbin
there's a lot of "everything else" :)
13:05 romainM
just wanting to know if it was a kind of "cold case" or something like that
13:05 pdurbin
honestly, it's hard to even remember what's in the backlog
13:05 pdurbin
cold case?
13:05 romainM
maybe I used the bad word
13:05 romainM
*expression
13:05 romainM
"forgotten" ?
13:06 pdurbin
yes, it has been forgotten (sadly)
13:06 pdurbin
no offense!
13:06 romainM
I don't
13:06 romainM
that's not "my" case
13:06 romainM
but jri will be very mad !
13:06 romainM
:D
13:06 pdurbin
eep!
13:06 * pdurbin
hides from jri
13:07 pdurbin
romainM: making a pull request helps keep issues on our mind because we start to feel bad if pull requests have been open for a long time
13:08 pdurbin
a pull request makes issues less likely to be forgotten
13:08 pdurbin
also, calling in to talk about issues helps remind us
13:09 pdurbin
I hope this is making sense.
13:11 romainM
I understand, that was clear ;)
13:11 pdurbin
good :)
13:12 pdurbin
romainM: what's wrong with Google Analytics anyway? Why would someone want to use Piwik instead?
13:13 romainM
would say data control, but jri will answer better than me
13:14 pdurbin
ok
13:15 jri
Hi pdurbin, I'm unfortunately not available for a call the next week. But I'll try the PR ! I didn't do it last time because we were still discussing on the issue, and after that I had others stuff to do.
13:16 pdurbin
jri: no problem. We have a call every other week.
13:17 pdurbin
jri: without a pull request it's easy to forget about an issue. Sorry. :(
13:19 jri
We don't use Google analytics for data privacy, and because Piwik respect the CNIL (french commission about liberty and privacy) recommandations, and because it's free and opensource, not intrusive. It's also support many CMS
13:20 pdurbin
Ok. Do you think any installations of Dataverse would use both at the same time?
13:22 jri
Yes I think. And for me, it have to.
13:22 pdurbin
ok
13:22 jri
Many organisation use both Google and Piwik
13:23 jri
To compare analytics between platforms
13:24 pdurbin
makes sense
13:30 pdurbin
jri romainM: so your (our) goal should be to move https://github.com/IQSS/dataverse/issues/3018 forward from "Backlog" to "Development" or "Code Review" at https://waffle.io/IQSS/dataverse
13:33 romainM
with a pull request ?
13:34 romainM
jri just made one :)
13:34 pdurbin
I saw! Piwik integration by jri-sp · Pull Request #3374 · IQSS/dataverse - https://github.com/IQSS/dataverse/pull/3374
13:34 pdurbin
great!
13:34 jri
I don't know what to do with 2. Pull Request Checklist :/
13:34 pdurbin
jri: you did fine. Thanks!
13:35 pdurbin
I just dragged your pull request to "Code Review" in Waffle.
13:38 pdurbin
and just left a comment on the pull request
13:40 jri
all these waffles are making me hungry
13:40 pdurbin
heh
13:40 pdurbin
I left a comment on the issue too
13:40 pdurbin
jri: thanks for the pull request!
13:40 pdurbin
romainM: thanks for reminding me about this!
13:41 romainM
np, jri reminded me :D
13:48 pdurbin
good
13:48 romainM
thanks for all this
13:50 pdurbin
oh sure. again, please call in some day if you can
13:51 donsizemore joined #dataverse
13:55 djbrooke joined #dataverse
13:57 romainM
we'll try :)
14:13 djbrooke joined #dataverse
14:20 djbrooke joined #dataverse
14:21 djbrooke joined #dataverse
14:23 djbrooke_ joined #dataverse
14:30 pameyer joined #dataverse
14:51 donsizemore joined #dataverse
14:59 djbrooke joined #dataverse
15:26 djbrooke joined #dataverse
15:29 djbrooke joined #dataverse
15:32 djbrooke joined #dataverse
15:51 djbrooke joined #dataverse
15:52 donsizemore joined #dataverse
16:30 djbrooke joined #dataverse
16:58 djbrooke joined #dataverse
17:04 djbrooke_ joined #dataverse
17:25 djbrooke joined #dataverse
17:52 jri joined #dataverse
18:21 djbrooke joined #dataverse
18:31 djbrooke_ joined #dataverse
18:33 djbrooke_ joined #dataverse
18:47 djbrooke joined #dataverse
19:11 djbrooke joined #dataverse
19:28 djbrooke joined #dataverse
19:49 axfelix joined #dataverse
20:03 djbrooke joined #dataverse
20:07 djbrooke joined #dataverse
20:15 pdurbin
romainM: still there?
20:56 axfelix joined #dataverse
21:04 axfelix joined #dataverse
21:12 djbrooke joined #dataverse
21:14 djbrooke_ joined #dataverse
21:15 djbrooke joined #dataverse
21:19 cads joined #dataverse
21:24 cads
Hey guys, I've got a quick question. I'm working with the USDA SR28 nutritional data reference, which is a relational database containing over 8000 foot items, with over 30 nutrients per food item. The tables of the database are distributed in a somewhat unwieldy set of ASCII files, requiring a fair bit of work to restore the table's schema.
21:25 cads
I'd like to publish the database to a dataverse repository in a format that is easier to work with, and I was wondering if there are any guides for archiving relational databased with dataverse
21:42 romainM joined #dataverse
21:42 telnoratti joined #dataverse
21:42 cads joined #dataverse
21:42 skay_ joined #dataverse
21:42 rhiaro joined #dataverse
21:42 balo joined #dataverse
21:42 jeffspies______ joined #dataverse
21:42 bjonnh joined #dataverse
21:42 shauna joined #dataverse
21:42 bricas_ joined #dataverse
21:42 sivoais joined #dataverse
21:42 skay joined #dataverse
21:42 yoh joined #dataverse
21:42 majest1c joined #dataverse
21:42 pameyer joined #dataverse
21:42 axfelix joined #dataverse
21:42 pdurbin_m joined #dataverse
21:42 JonathanNeal joined #dataverse
21:42 LyndsySimon joined #dataverse
21:49 djbrooke joined #dataverse
21:51 pdurbin_m
cads: hi! still there?
21:52 pdurbin_m
please email support
21:54 pdurbin_m
or https://groups.google.com/forum/m/#!forum/dataverse-community
22:08 cads
Thanks pdurbin_m, I'll request info on the forum
22:09 pdurbin_m
cads: thanks, I'm typing from my phone. :)
22:10 pdurbin_m
cads: how many files is your data in?
22:12 pdurbin_m
in general, files in Dataverse don't know about each other
22:12 cads
The data consists of 12 tables, arranged in schema: https://github.com/maxsu/USDA-SR28/blob/master/Physical%20Schema.png
22:13 cads
so, 12 ascii files
22:13 cads
In case the github page has trouble loading on your phone: https://github.com/maxsu/USDA-SR28/blob/master/Physical%20Schema.png?raw=true
22:14 pdurbin_m
hmm
22:15 pdurbin_m
Dataverse uses postgres on the back end but uploaded files go to a filesystem.
22:15 pdurbin_m
it sounds like you want data to go in a database
22:17 cads
I have seen one project that uploaded a database as a collection of MySQLdump files: https://dataverse.harvard.edu/dataset.xhtml?persistentId=hdl:1902.1/11337
22:17 axfelix joined #dataverse
22:18 cads
It's not as clean as tabular data - for example, dataverse users can't use TwoRavens to play with the data.
22:19 cads
they have to explore the data offline
22:21 cads
this could be an opportunity to find a A) a friendly relational database interchange format and B) an online relational data exploration program. I could then teach dataverse to recognize data format in A, and offer the users the ability to explore it with the tool from B.
22:25 pdurbin_m
yeah people have asked if TwoRavens can operate on more than one file at a time
22:27 pdurbin_m
at least with that SQL dump you can load it up somewhere
22:27 pdurbin_m
offline, like you said
22:28 pdurbin_m
cads: do other data repositories have the feature you're interested in?
22:30 cads
I'd say I'm still searching, but I haven't found anything. I'm looking at LabKey, and ckan.
22:31 pdurbin_m
cads: ok, please keep me posted
22:31 pdurbin_m
and you should still explain your use case on the Google group
22:33 pdurbin_m
maybe there's some kind of third party service that could be integrated with
22:34 pdurbin_m
"Explore SQL File"
22:42 pdurbin_m
or something
23:33 pdurbin
interesting: LabKey – Data Management & Workflow Solutions for Biomedical Research - http://www.labkey.com
23:33 pdurbin
pameyer: have you heard of this thing?
23:34 pdurbin
or is biomedical totally different than structual biology :)
23:36 pdurbin
cads: ckan I've heard of :)
23:44 cads joined #dataverse
