Time
S
Nick
Message
08:28 jri joined #dataverse
08:29 jri joined #dataverse
08:44 jri joined #dataverse
12:11 larsks joined #dataverse
13:45 jri joined #dataverse
13:53 jri joined #dataverse
14:58 jri joined #dataverse
15:01 pameyer joined #dataverse
15:08 julian87 joined #dataverse
15:57 pdurbin
pameyer: what about sysadmin types and dependencies? :)
15:58 pdurbin
I was a sysadmin type once.
15:58 pdurbin
Once a sysadmin, always a sysadmin?
16:01 pameyer
pdurbin: I knew the "once" bit; but could use a 2nd opinion.
16:02 pameyer
for production DCM installs, my thinking of converting pip dependencies to rpms looks like it would require walking the dependency tree deeper than I'd like.
16:02 pameyer
do you think asking a sysadmin to do `rpm install $r1 $r2 $r3` ; `pip install $r4 $r5 $r6` has a bad smell?
16:04 pdurbin
oh man, I'm not enough of a Python person to weigh in on this. maybe ask andrewSC
16:04 pameyer
andrewSC: any thoughts?
16:05 andrewSC
hmmmm
16:06 andrewSC
kind of an odd thing.. to ask? why convert in the first place?
16:06 andrewSC
pameyer: ^^
16:06 pdurbin
pameyer: I should probably look at the current installation instructions for DCM again. I believe they are linked from the Dataverse Dev Guide
16:07 pameyer
the bigger picture is converting a component where the current install procedure is roughly "clone repo, run ansible, ask pameyer for help" to "install dependencies, install dcm rpm, edit config files"
16:07 pdurbin
Yeah, from here: http://guides.dataverse.org/en/4.8.5/developers/big-data-support.html
16:07 pameyer
but some dependencies are in pip, and those have dependencies on other pip packages
16:07 pameyer
me converting the entire pip repo to rpm seems like a suboptimal approach
16:07 jri joined #dataverse
16:08 pdurbin
pameyer: you've done some good thinking over at https://github.com/sbgrid/data-capture-module/issues/25
16:08 pameyer
pdurbin: some progress has been made, but not yet pushed to that repo (because it's not fully operational)
16:09 pdurbin
pameyer: is there a GitHub issue on the Dataverse side about making it easier for someone other than the author of the DCM to run it? DCM is sort of the only "big data support" in town for Dataverse right now.
16:10 pameyer
pdurbin: not that I'm aware of
16:10 andrewSC
pameyer: ahh I gotcha.. To be quite honest, if it were me, I'd leave the deps in their original states. I don't think rpm $dep{1,2,3}; pip install $foo is a bad thing.
16:10 pdurbin
Ok, but on community calls I believe we may have hinted at a dual mode or whatever we call it.
16:10 andrewSC
If you look at it the other way, if you converted those pip deps into rpms, then you're on the hook for maintaining those rpms
16:10 pameyer
andrewSC: thanks!
16:10 andrewSC
np
16:10 pameyer
yeah; that too
16:11 pameyer
dual-mode is pre-design at the moment; but DCM/RSAL only *should* be easier to setup
16:11 pdurbin
pameyer: "(Courtney) We are interested in having both HTTP and rsync. Do we know what release this will land in? (Danny) It's not on our roadmap yet. Stay tuned." https://groups.google.com/d/msg/dataverse-community/HKuQUrmdmE8/r7WJXLbsAwAJ
16:12 pameyer
yup
16:12 pdurbin
Anyone else interested? Rebeca was trying to set it up, I think.
16:13 andrewSC
also, i've been a big using and are fan of pipenv for my projects. I'm not entirely sure if it fits your usecase or if you know about it and actually decided not to use it, but yeah
16:13 andrewSC
i've been using and* lol
16:18 pameyer
haven't looked at pipenv; but virtualenv + pip has been my usual go-to for python web apps
16:20 andrewSC
mhmm
16:21 pdurbin
pameyer: so just Courtney and Rebeca so far? Our first customers. :)
16:22 larsks joined #dataverse
17:16 pdurbin
pameyer: even if we only have two so far, more will learn of the feature here, which is good: http://guides.dataverse.org/en/4.8.5/user/find-use-data.html#downloading-a-dataverse-package-via-rsync
17:24 pameyer
pdurbin: and it'll make testing easier
17:33 pdurbin
pameyer: Rebeca is a hacker but Courtney has Nick (one of two Nicks) at TDL to do sysadmin stuff. Danny and Leonid and I had a call with him the other day. Are you intersted in getting his opinion? He's a good egg.
17:38 pameyer
pdurbin: sure, but maybe not until things are closer to converging
17:40 pdurbin
pameyer: ok. He's the guy who opened https://github.com/IQSS/dataverse/issues/4439
17:41 pdurbin
(after we had that call with him)
17:41 pameyer
gotcha - I hadn't realized that was his username
17:42 pdurbin
Yeah, internally I have a spreadsheet where I track who is who from a GitHub perspective. I get confused easily and there are an increasing number of people to keep track of, which is a good thing.
17:44 jri joined #dataverse
17:58 danmcp joined #dataverse
18:41 pdurbin
Maybe we should have a "people" page on https://dataverse.org where people can add profiles for themselves or something. A place where people can say they're part of the Dataverse community.
19:35 pdurbin
opt-in, of course
21:13 andrewSC joined #dataverse
22:25 danmcp joined #dataverse
