Time
S
Nick
Message
07:41 jri joined #dataverse
08:34 poikilotherm joined #dataverse
09:33 andrewSC joined #dataverse
10:14 poikilotherm
Test
10:20 poikilotherm[m] joined #dataverse
11:12 poikilotherm joined #dataverse
11:14 poiki-test joined #dataverse
11:54 pdurbin joined #dataverse
11:58 poikilotherm joined #dataverse
11:58 poikilotherm
Good morning pdurbin
11:58 poikilotherm
I'm testing using the Matrix IRC bridge right now
12:11 pdurbin
orly
12:11 poikilotherm
Works pretty well so far
12:12 pdurbin
You're using Riot?
12:12 poikilotherm
Aye
12:12 pdurbin
Riot web or Riot desktop?
12:12 poikilotherm
There is some delay (about 1-2 seconds) in sending/receiving messages
12:12 poikilotherm
Tried both, currently using desktop
12:14 pdurbin
Cool. I haven't tried the desktop client. I really, really don't like using chat in a web browser so I guess I should try the desktop client. Is your account on the main Matrix server? From what I understand Matrix is federated so it wouldn't have to be.
12:14 poikilotherm
Nope, I used chat.privacytools.io
12:16 poikilotherm
The room member list is not working perfectly - everybody is shown as offline for some reason
12:16 poikilotherm
And I did not find an option yet how to link publicly to this bridged room
12:18 pdurbin
I'm not sure where the link would be. Would you be able to share a screenshot?
12:19 poikilotherm
I'm not sure what you mean ;-)
12:19 pdurbin
Maybe you could create an issue at https://github.com/IQSS/chat.dataverse.org/issues called "Matrix" and upload some screenshots of what you're seeing. I'm having a little trouble imagining it, having used Matrix so little.
12:24 pdurbin
I created a fake account on the main Matrix server a while ago to play with it. I don't know. I have so many chat accounts. I'm not sure when I create a real Matrix account. Maybe if I want to chat with Mozilla folks in the future once they shut down their IRC server.
12:24 poikilotherm
Well there are Slack bridges...
12:25 poikilotherm
I was wondering if this might be a possible option to interconnect with all guys sitting over there.
12:26 pdurbin
Hmm. What's the user story? "As a Matrix user, I want to chat in some channels on freenode IRC ."? Something like that?
12:27 poikilotherm
https://github.com/IQSS/chat.dataverse.org/issues/12
12:27 poikilotherm
IMHO that would be just a part of it
12:29 poikilotherm
"As a Dataverse community member I would like to connect with other members on Matrix or IRC and IQSS on Slack"
12:29 poikilotherm
* "As a Dataverse community member I would like to connect with other members on Matrix or IRC and IQSS on (private) Slack"
12:31 pdurbin
Thanks, it's starting to make sense. :)
12:31 pdurbin
What about the Gitter channel you created? Would you bridge that too?
12:32 poikilotherm
Do you think it's to be used by anyone?
12:32 poikilotherm
We could of course. Easy peasy
12:33 GitterIntegratio joined #dataverse
12:34 pdurbin
There is no chat history in the Gitter channel you made but there are six people in it. You, me, Stefan, Peter, Jonas, and Don.
12:35 pdurbin
Heh. Now there's some history in Gitter but I don't see your "Test matrix integration" message here in IRC .
12:35 poikilotherm
Failed to make link: You don't have permission to post that to the room. user_level (0) < send_level (100)
12:36 poikilotherm
I can't enable the integration because I'm just a user...
12:38 pdurbin
A user where? Here in IRC ? You're a non-moderator?
12:38 poikilotherm
Most likely on IRC . IIRC the user permissions are synced from IRC to Matrix
12:39 pdurbin
I'm happy to make you a moderator here in IRC if you'd like. I think I'm still the only moderator, which is not great.
12:39 poikilotherm
Heh. We could try the integration then :-D
12:40 pdurbin
I could create an issue to document how to add and remove moderators from IRC .
12:43 pdurbin
I'd probably use this as a starting point: http://crimsonfu.github.io/2012/02/06/crimsonfu-freenode-irc-channel-setup.html
12:48 pdurbin
Ok, I just created this issue: https://github.com/IQSS/chat.dataverse.org/issues/13
12:48 pdurbin
time for breakfast :)
12:50 poikilotherm
Nice!
12:51 donsizemore joined #dataverse
15:15 pdurbin
We haven't had standup in 2020 yet but fingers crossed that we'll have enough people to have it in about an hour. Does anyone want me to mention anything?
15:16 pdurbin
poikilotherm: I'm planning on opening the box you sent.
15:17 donsizemore
@pdurbin how may i bribe anyone for some lessons learnt(™) on running Dataverse in AWS? anything they wish they had done differently?
15:17 poikilotherm
🙂
15:25 pdurbin
donsizemore: are you taking a lil' trip? :) Can I come? :)
15:25 donsizemore
@pdurbin shore!
15:25 jri joined #dataverse
15:25 pdurbin
nice
15:26 pdurbin
Well, the direct download from S3 is a life saver.
15:26 pdurbin
I'm looking forward to Jim's direct upload to S3.
15:27 pdurbin
I'm sure RDS is way more stable than any kind of HA Postgres cluster we could try to sling together.
15:28 pdurbin
Downloads cost you. Higher Amazon bill.
15:29 pdurbin
We aren't in control of our load balancer. ELB. But it seems to work fine.
15:33 pdurbin
donsizemore: are you thinking multiple Glassfish servers or just one?
16:10 donsizemore
@pdurbin probably just one, but AWS' RDS sounds worth it
16:12 pdurbin
ok
16:21 donsizemore
also, i'll give the python3 installer another whirl
16:33 pdurbin
donsizemore: thanks! Your ears must have been burning!
16:33 pdurbin
poikilotherm: thanks for the award!!
17:39 jri joined #dataverse
17:41 pdurbin
poikilotherm: I just tweeted about it: https://twitter.com/philipdurbin/status/1214240481527250945
17:41 pdurbin
Thanks again!
18:25 donsizemore joined #dataverse
18:29 donsizemore
@pdurbin hey Chief(congrats!) does anyone there happen to know what size RDS instance harvard went with?
18:54 pdurbin
donsizemore: so, I just stopped by Leonid's office. I think the short answer is I don't know. He suggested going on our QA box and looking at how big the database is. Want me to do that?
19:25 donsizemore
@pdurbin, eh, it's cool. i do have another question now, though.
19:25 pdurbin
hit me
19:26 poikilotherm
@pdurbin you're welcome ;-)
19:26 donsizemore
in https://github.com/IQSS/dataverse/issues/3937#issuecomment-571189043 it sounds like Leonid wants to maintain backwards compatibility
19:27 donsizemore
but since centos seems to be the target platform, rather than dropping python2/3 switches in place, okay for me to just make python3 the default? since 2 is eol
19:27 pdurbin
I'm fine with not testing Python 2. RIP.
19:33 pdurbin
I should check back on the Python clock, to see what it says.
19:34 donsizemore
"Python 2 will reach end of life (EOL) on January 1st, 2020."
19:35 pdurbin
yeah
19:35 pdurbin
and all zeros at https://pythonclock.org
19:36 pdurbin
Should Dataverse sign the Python 3 statement? This: https://python3statement.org
19:37 donsizemore
the orange logo isn't far from a stamp =)
19:37 pdurbin
:)
19:37 pdurbin
The main thing I want is for it to run on Python 3.
19:37 pdurbin
And to not have to maintain the old Perl script.
19:38 pdurbin
And for the new Python 3 script to be useful to you and others.
19:38 gteague joined #dataverse
19:38 pdurbin
So if it isn't useful, please let us know and we can try to make it useful. :)
19:46 gteague
Hey Philip, et al. Quick question: I'm trying to leverage an External Tool (File, Explotre) but want to accept ANY contentTypes. Is there a catch-all contentType to specify in my External tool manifest, or am I just going to have to specify all the forseeable contentTypes that might be used?
19:47 pdurbin
gteague: sadly, there is no wildcard content type. You are very welcome to create an issue about this at https://github.com/IQSS/dataverse/issues . What does your tool do? :)
19:51 gteague
Ive been working at doing a Globus Integration for Dataverse, and one of the features we would like is to allow researchers to easily push files/datasets they have access to to our local HPC cluster. If all goes well, I plan on posting it up for the community.
19:53 gteague
OK! Well Thanks for the quick response!
20:09 pdurbin
gteague: Globus! Awesome! Is there any code we can look at already? :)
20:20 gteague
heh. Once I get a proof of concept done, I might; Right now it's really specific to our needs. and I'm trying to meet deadlines & Demos! First thing I'll do is post to the basic idea big data DV Google group and RFC .
20:22 pdurbin
gteague: ah, ok. So for now you don't plan to offer it to the community as an external tool. That's fine. But maybe some day others can get it working on their HPC cluster. That reminds me. Have you heard of Open OnDemand?
20:26 gteague
No. looking at it now... if it has a slurm scheduler, I'm sold!
20:26 pdurbin
Heh. Maybe you can give me feedback on this issue I opened: https://github.com/OSC/ondemand/issues/354
20:27 pdurbin
I checked with them first (via email) and they said to go ahead and create an issue.
20:34 gteague
Ohh.. that's where I heard it before. One of our HPC sysAdmins just installed OnDemand; I'm going to integrate with his side of things at some point in the future. Once I grok it, I'll see what I can do.
20:35 pdurbin
I've only watched a five minute OnDemand video. And listened in on a big meeting. And emailed with them a bit.
20:40 gteague
OK. well one of my goals is to facilitate researcher's HPC access. Right now I've just been focusing on moving data to and fro via Globus. Once that's solved, I might be jumping into this.
20:41 gteague
Thanks! (And I really appreciate all you do - I think you need about 5 more FTE and then things can really take off!)
20:41 pdurbin
Cool. You're aware of the Globus working going on by installations of Dataverse in Canada, right?
20:42 pdurbin
I took some notes from what they were saying during a community call the other month.
20:43 gteague
OK, I'll check the google group posts - I can find the rabbit trail from there, right?
20:43 pdurbin
I'm talking about stuff Amaz from Scholars Portal was saying: https://groups.google.com/d/msg/dataverse-community/0hu9xXrwOPI/TaMZwOhFAwAJ
20:44 pdurbin
"How do we upload 60,000 little files? How do we upload large data? Globus seems to work well for this."
20:44 pdurbin
"Globus Personal Connect tool"
20:44 pdurbin
stuff like that
20:46 gteague
ok, yeah - that all sounds like the train I'm currently riding. I'll see what I can see.
20:46 pdurbin
Cool. And yeah, please do post to the big data list, or the main list. Or both. People would love to hear what you're up to.
23:54 jri joined #dataverse
