Time
S
Nick
Message
02:49 axfelix joined #dataverse
07:24 bencomp joined #dataverse
10:29 iqlogbot joined #dataverse
10:29 Topic for #dataverse is now Dataverse: http://dataverse.org | logs at http://irclog.iq.harvard.edu/dataverse/today
12:23 freeman joined #dataverse
12:34 pdurbin
freeman: hi! I saw you had a question. we were wondering how similar your request is to this one: Embargo Period for Releasing Datasets & Dataverses · Issue #343 · IQSS/dataverse - https://github.com/IQSS/dataverse/issues/343
12:37 freeman
Hello pdurbin, Many thanks !!
12:42 pdurbin
oh sure. so is it similar? seemed somewhat different to me...
12:43 freeman
yes, this link provided is very similar to what we wish to have at hopkins, the metadata can be released but sometimes there needsto be embargo with researchers to post their data files at a later time to an end time.
12:46 freeman
The timeframe in which to make data files available in that issue posting is perfect. It would be nice for DVN version 4.0 or 4.0.1 to include a mechanism to allow the embargo feature of data files, if there is time to add this to the busy schedule of developers' todo list. Please correct me if i am mistaken, this feature is not in DVN version 3.6.0+ ?
12:49 freeman
i've been reading up on the progression of DVN and its many software which planned to be a part of DVN such as GUI side of Zelig, this is awesome and there are a ton of new features on GeoSpatial science plus ingestation of larger files 2 gigs+ in this 4.0 release that we at hopkins are looking forward to in using this new version of DVN.
12:51 freeman
Congrats DVN team ! I am looking to upgrade to this release from 3.6.0,
13:10 pdurbin
freeman: thanks! currently that embargo feature has a milestone of Dataverse 4.1
13:10 pdurbin
so we'll have to ship Dataverse 4.0 first
13:11 pdurbin
freeman: the thing I'm confused about is the "end time" part of you saying "post their data files at a later time to an end time"
13:11 pdurbin
are you saying the files would no longer be available at some point?
13:21 posixeleni joined #dataverse
13:22 freeman
pdurbin: sounds good, ok i just confirmed this with someone higher up. We love the restricted feature in version 3.6.x. For data files which are able to be embargo, we would like to set a timeframe to allow datafiles to be accessible for a length of period but the data files will remained to be in storage of DVN , once the timeframe as been reached, restricting the datafiles from outside (public) access will be perfect for us ju
13:23 posixeleni
@freeman hi! Phil told me about your dataverse feature question about having a start and end date for dataset availability http://irclog.iq.harvard.edu/dataverse/2014-09-24
13:25 freeman
Hello posixeleni: Thansk for the link, i will look at that as well. pdurbin is providing me with excellent info as well. I learned that this feature is not currently availble in our 3.6.x DVN but will be available in 4.1 which is kool. many Thanks. :)
13:26 posixeleni
we can put in a feature request for us to review supporting a "dataset availability schedule" that has a start and an end date for public access.
13:26 posixeleni
the link was just referring to your previous discussion with @pdurbin
13:27 freeman
posixeleni: if its all doable inside DVN for version 4.1, yes please !
13:27 pdurbin
posixeleni: this is different enough to justify a new issue for tracking purposes, right?
13:28 posixeleni
i think so, IMHO embargo period is more about when the data should be 1st released publicly without an end period. This reminds me more of a "Retention Schedule" so when do you make something available and for how long. Correct?
13:29 pdurbin
can you two file a new issue then?
13:30 posixeleni
pdurbin: yes i certainly can take care of that and send the url to freeman to add any additional comments?
13:30 posixeleni
brb coffee
13:30 freeman
posixeleni: sounds Great.
13:54 posixeleni
freeman: please review this new ticket and feel free to add any comments directly there: https://github.com/IQSS/dataverse/issues/934
13:54 posixeleni
i hope i got your requirements right
13:56 freeman
posixeleni: Perfect ! Once the time frame for the datafiles are up then restrict the content (datafiles).
13:57 posixeleni
freeman: about the restrictions, do you just want the files to be restricted or the dataset metadata as well?
13:59 freeman
posixeleni: just the files to be restricted, but the metadata which are the study to be still showing on DVN.
13:59 posixeleni
thanks will make sure that's evident in the ticket
14:01 freeman
many thanks.
14:02 pdurbin
jeffspies or LyndsySimon question about virtualenv
14:59 axfelix joined #dataverse
15:04 pdurbin
cool so you guys made this ticket: Ability to Set a Dataset Availability Schedule · Issue #934 · IQSS/dataverse - https://github.com/IQSS/dataverse/issues/934
15:49 axfelix joined #dataverse
16:36 metamattj joined #dataverse
17:00 garnett joined #dataverse
17:13 garnett joined #dataverse
17:22 freeman joined #dataverse
17:30 freeman
where do the user informational text are held in inside DVN, we seem to change them alot here for reason which are unknown to me. for example:
17:30 freeman
where might be a place this text is held ? "Access to some files is restricted, and those files are not available for downloading. Check the Terms of Use for more information. Send a request"
17:37 metamattj joined #dataverse
17:38 pdurbin
freeman: looks like it comes from here: https://github.com/IQSS/dvn/blob/3.6.2/DVN-root/DVN-web/src/main/webapp/study/StudyFilesFragment.xhtml#L55
17:39 pdurbin
I found that with this search: https://github.com/IQSS/dvn/search?utf8=%E2%9C%93&q=%22those+files+are+not+available+for+downloading%22
17:41 freeman
pdurbin: you ROCK !!!! many thanks.
17:43 pdurbin
:)
17:43 pdurbin
I'm here all week ;)
17:44 freeman
pdurbin: Nice. usually i can figure these things out without submitting a ticket to Kevin. its either in the DB or in the properties files somewhere inside DVN but everyonce in a while i need some assistance. lol
17:45 freeman
trying to minimize DVN user support group workload due to fast approaching dvn 4.0 release and i am certain kevin is busy testing the functionalities of all kinds of new features at the moment. Thanks :)
17:46 pdurbin
yeah, we're all pretty busy. you could try a search on github. again, that's what I often do :)
17:48 freeman
kool, will do.
18:09 LyndsySimon
pdurbin: shoot.
18:09 LyndsySimon
I'm mobile at the moment, so I may be delayed.
18:09 pdurbin
LyndsySimon: oh! nevermind, I figured it out: vagrant works with apache and production settings #1 · ffcbfca · IQSS/milestone-reader - https://github.com/IQSS/milestone-reader/commit/ffcbfcaaa84a58f9f4fd088ad4270b2cc4210281 :)
18:18 LyndsySimon
Good deal :-)
18:44 bencomp joined #dataverse
19:14 pdurbin
bencomp: thanks for all the detail in that ticket
19:15 bencomp
you're welcome
19:18 bencomp
hope it helps :)
19:18 pdurbin
yep, I'll probably add a couple more links about raw types I was looking at
19:26 bencomp
in the meantime, I'm looking at Eclipse v4.4 and will try to get GitHub issue integration
19:39 pdurbin
ok
19:39 pdurbin
bencomp: is there a feature you're interested in working on?
19:42 bencomp
this is firstly for another project
19:42 bencomp
I shouldnt actually code on dataverse… ;)
19:43 pdurbin
yes you should :)
19:44 axfelix joined #dataverse
19:45 bencomp
I retweeted "free as in 'put all your free time in to get it to run'" today….
19:47 bencomp
I spent some work time today talking with Mercè. She owes me a beer for her train ticket ;)
19:54 pdurbin
:)
19:55 pdurbin
Martin Pittenauer on Twitter: "free as in "requires all your free time to get it running"." - https://twitter.com/map/status/514712691509035009
19:55 pdurbin
heh. that's awesome
19:56 pdurbin
bencomp: I saw you favorited this thing I tweeted today: Philip Durbin on Twitter: "@edsu you can upload > 2 GB files via the API in DVN 3.x and in Dataverse 4.0 there are no known limits: https://t.co/AM33fcjJsH " - https://twitter.com/philipdurbin/status/514813244167688193
20:00 bencomp
I favourite as a bookmark
20:02 pdurbin
ah
20:04 bencomp
wanted to look later
20:10 pdurbin
bencomp: I just committed this: for use with mvn -DcompilerArgument=-Xlint:unchecked compile #933 · a7d24b7 · IQSS/dataverse - https://github.com/IQSS/dataverse/commit/a7d24b7773533f5fd4f07e65bf823472e97a52be
20:10 pdurbin
bencomp: so I can see those unchecked warnings from the command line with `mvn`
20:11 pdurbin
maybe we could even set up a jenkins job ("strict dataverse") that runs `mvn -DcompilerArgument=-Xlint:unchecked compile`
20:11 pdurbin
then we could watch the number of errors go down as we fix the code
20:12 bencomp
+1
20:13 pdurbin
:)
20:29 bencomp
hmpf, the eclipse marketplace doesn't live up to expecations
20:29 pdurbin
bencomp: and you have a tool that just fixes all these? that's how you made that commit?
20:30 bencomp
IDE 's "quick fix"
20:30 pdurbin
ok. but you went through each one?
20:30 pdurbin
or the IDE will quick fix them all at once?
20:30 bencomp
yes B)
20:30 pdurbin
phew
20:32 bencomp
github plugin is shown in the "market" but there is "no repository"
20:35 pdurbin
bencomp: https://github.com/michbarsinai is in this channel from time to time. If you see him, please point him to the comment I just made: https://github.com/IQSS/dataverse/pull/933#issuecomment-56734011
20:35 bencomp
isn't he on your team?
20:36 pdurbin
he is but he moved to israel
20:40 bencomp
that is quite a timezone shift
20:49 pdurbin
yeah
20:49 pdurbin
bencomp: so if he's in here when you are, jump on him :)
20:50 pdurbin
i'll see him in san francisco next week for javaone. we're giving a talk together
20:57 metamattj joined #dataverse
21:01 bencomp
what is his handle?
21:02 pdurbin
buh
21:02 bencomp
who would have thought? ;)
21:03 pdurbin
michbarsinai
21:03 pdurbin
http://irclog.iq.harvard.edu/search.pl?channel=dataverse&q=michbarsinai
21:08 garnett joined #dataverse
21:08 bencomp
ok, will try to remember
21:09 pdurbin
that refactor is a bit of a low priority for me. lots to do
21:09 pdurbin
but I'm curious what he thinks
21:13 pdurbin
he's big into type safety, Scala, etc.
21:20 bencomp
I thought there was a timezone difference between here and Israel - and it's past my bedtime...
21:20 bencomp
"I'd say more, but I'm typing this on a smartphone :-("
21:20 pdurbin
bencomp: wait!
21:20 pdurbin
:)
21:21 pdurbin
bencomp: now you (and we all) can see the warnings here: https://build.hmdc.harvard.edu:8443/job/DVN_4_0_Beta_Azure/39/console
21:22 bencomp
awesome!
21:23 pdurbin
:)
21:23 pdurbin
I think the first step is awareness
21:26 bencomp
if you can get that working quickly, maybe you can try https://github.com/kongchen/swagger-maven-plugin too
21:27 pdurbin
bencomp: I'm pinging my build master
21:28 esotiri_ joined #dataverse
21:28 bencomp
I think you need to put the resulting doc in a place that is web accessible, so that the URIs point at the right place and you don't get CORS issues
21:28 pdurbin
bencomp: what about building our javadoc. do you care about that?
21:28 pdurbin
bencomp: please meet my build master, esotiri_ :)
21:29 bencomp
hi esotiri_ :)
21:30 bencomp
not as much right now as you should, pdurbin ;)
21:30 esotiri_
hi bencomp :)
21:31 bencomp
but if I ever look at the code, I sometimes have to look hard to know what some method does
21:33 pdurbin
bencomp: can you help esotiri_ with that swagger thing?
21:33 esotiri_
phil: https://wiki.jenkins-ci.org/display/JENKINS/Warnings+Plugin does .. The Warnings plug-in scans the console log or specified log files for warnings of different formats and reports the number of warnings found.
21:33 bencomp
in the 3.6 code, I had to follow calls to methods to find out what kind of "study ID" was meant in the Handle tab in the networkAdmin's utilities - full handle, local handle part or database native ID… That is where javadoc would have come in handy
21:34 pdurbin
esotiri_: that sounds perfect! we want the number warnings to go down
21:34 bencomp
I have an adjusted pom.xml in a branch 'swagger' on my desktop
21:35 bencomp
now is not the time to turn it on, I could push something on Friday
21:36 pdurbin
bencomp: we could build from your branch, maybe
21:37 pdurbin
bencomp: is the swagger output supposed to look like this? http://htmlpreview.github.io/?https://raw.github.com/kongchen/swagger-maven-example/master/generated/document.html
21:37 pdurbin
I found that at https://github.com/kongchen/swagger-maven-example
21:39 bencomp
pdurbin: yes, mostly, the examples I've seen are more dynamic, really like http://petstore.swagger.wordnik.com/
21:39 axfelix joined #dataverse
21:39 pdurbin
bencomp: ah. right. yes. very nice. I've seen this before
21:40 pdurbin
bencomp: that's how it will look if we build from your branch?
21:40 pdurbin
bencomp: I don't see a swagger branch at https://github.com/bencomp/dataverse/branches
21:41 bencomp
I tried three things, one of which got that result :)
21:41 bencomp
Github is not my desktop
21:41 pdurbin
:)
21:41 bencomp
I meant a machine in my home
21:43 bencomp
I already sinned by changing git history, I try to refrain from rebasing branches that I already pushed :)
21:43 pdurbin
how dare you
21:44 bencomp
finally got GitHub issues integration in Eclipse working :)
21:46 pdurbin
I thought it was past your bedtime
21:52 bencomp
it's (too) flexible
21:54 bencomp
esotiri_: just for my understanding - I won't say 'so I sleep well' - builds and deployments are not triggered by code changes but by you?
21:57 garnett joined #dataverse
21:58 * pdurbin
shakes esotiri_
21:58 * pdurbin
pours esotiri_ some coffee
22:00 pdurbin
I'm pretty sure that job is triggered manually.
22:01 pdurbin
oh, she's on a train. whoops :)
22:32 axfelix joined #dataverse
