Time
S
Nick
Message
07:15 lincoln joined #dataverse
07:16 lincoln
Hi everyone ! Does anyone have idea with analysis of Timeseries (of files) from Dataverse?
08:00 poikilotherm
Hi Lincoln, Dataverse does not support this out of the box. You might add a JavaScript based previewer, which can be maintained independent of the core project.
08:01 lincoln
thank you @poikilotherm
08:03 poikilotherm
What would be your use case? Asking out of curiosity 😁
08:05 lincoln
I have many timeseries datafiles and would like to add an external tool for visualization
08:06 lincoln
if possible could you provide me with a link to start with...
08:26 poikilotherm
https://github.com/GlobalDataverseCommunityConsortium/dataverse-previewers
08:35 lincoln
thanks
13:08 donsizemore joined #dataverse
13:58 pdurbin joined #dataverse
13:59 pdurbin
lincoln: a timeseries tool sounds awesome
14:00 pameyer joined #dataverse
14:38 lincoln
thank you @pdurbin. Are there any alternatives to streaming datas for dataverse?
14:38 lincoln
Suggestions are welcome
15:07 pdurbin
lincoln: hmm, have you played with the "file replace" functionality? It's in the UI too but here are the API docs: https://guides.dataverse.org/en/5.3/api/native-api.html#replacing-files
15:07 pdurbin
UI docs; https://guides.dataverse.org/en/5.3/user/dataset-management.html#replace-files
16:08 nightowl313 joined #dataverse
16:09 nightowl313
hi all ... wondering if anyone could describe the new auxiliary file feature in dv 5.3 .. i don't quite understand what it is, or how it really works! =D
16:10 nightowl313
does it just allow a remote system to add secret metadata to a file? lol
16:10 pdurbin
nightowl313: hey. I'm working on it now. Did you find the docs in the dev guide? It's experimental.
16:10 pdurbin
Here they are: https://guides.dataverse.org/en/5.3/developers/aux-file-support.html
16:11 nightowl313
yea, i read them, but I can't really visualize what is happening
16:11 pdurbin
Here's a preliminary look: http://ec2-34-238-194-179.compute-1.amazonaws.com/file.xhtml?fileId=5&version=1.0
16:11 pdurbin
(under Access File)
16:11 nightowl313
is it just adding an additional metadata text file to a file, but that file is hidden? (to be seen only on the storage outside of dv?)
16:12 pdurbin
No, aux files can be any file. PDF or whatever. You aren't limited to text files.
16:12 pdurbin
And aux files are not hidden. Try clicking "Access File" on that link above.
16:13 nightowl313
oh i see .. it is restricted .. i guess i don't understand what "differentially" private means ... what is the difference between this and just uploading a file and restricting it?
16:16 pdurbin
Differential privacy is a way to add noise to data. It helps you share summary statistics for data you can't otherwise share. We're working on integrating Dataverse with another project called OpenDP: https://opendp.org
16:17 pdurbin
So the idea is that you keep the file restricted in Dataverse but you can share somewhat noisy summary statistics of that data to give people an idea of what's in the data.
16:18 nightowl313
ah okay ... that makes sense! Thanks!
16:19 pdurbin
Oh good. It's a challenge to explain what differential privacy is. :)
16:20 nightowl313
the description in the OpenDP site helps a lot to break it down
16:21 pdurbin
That's great to hear. The site is brand new. Just launched the other day.
16:23 nightowl313
we've had conversations with folks we are collaborating with lately about private data and how to handle in this open environment, and I think this is going to be very helpful
16:23 pameyer
the wording is much tigher now :)
16:24 pdurbin
Yeah, we hear about private data all the time. That's why we're working on this. :)
16:31 nightowl313
+1 =D
16:49 donsizemore joined #dataverse
19:37 Mike94 joined #dataverse
19:37 Mike94
hi
19:59 ethan joined #dataverse
19:59 ethan left #dataverse
20:12 lincoln joined #dataverse
20:12 nightowl313 joined #dataverse
20:13 lincoln
if I want to add extra metadata fields ( more than default/customized metadata) for a file in a dataset , are there any other alternatives?
20:21 pdurbin
lincoln: are you saying you don't want to add your own custom metadata block? This: https://guides.dataverse.org/en/5.3/admin/metadatacustomization.html
20:21 pdurbin
oh, you said for a file
20:22 lincoln
i have done it for a dataset but want to be file specific as well if possible
20:22 pdurbin
You can't customize file level metadata. We do have an experimental feature you might want to look at though: https://guides.dataverse.org/en/5.3/developers/aux-file-support.html
20:24 lincoln
so we can add other required fields/ metadata along with the file.. is it so?
20:26 pdurbin
It's more like files can have files. Auxiliary files.
20:27 pdurbin
Like, a file could have its own README if you want.
20:27 pdurbin
It's new and experimental. We have a specific use case in mind.
20:28 lincoln
aah thank you
20:29 lincoln
its really cool and that saves a lot of time for me
20:29 pdurbin
Oh good.
20:29 pdurbin
That said, lots of people have asked for more metadata at the file level. Maybe some day.
20:30 lincoln
it would be more flexible for files generated during experiment ( Example: during design of experiments)
20:31 lincoln
and thank you again
21:03 pdurbin
sure
21:03 pdurbin left #dataverse
