IQSS logo

IRC log for #dataverse, 2017-09-14

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

All times shown according to UTC.

Time S Nick Message
02:33 axfelix joined #dataverse
10:46 donsizemore joined #dataverse
14:12 bjonnh pdurbin: looks like this zip checkbox thing gets interest
14:23 andrewSC joined #dataverse
14:54 pdurbin bjonnh: no kidding. I added the "help wanted: code" label to it and my "mentor: pdurbin" label
14:59 pdurbin bjonnh: I pulled the docker/openshift issue into development and assigned myself to it. Maybe you and donsizemore can help me with it: https://github.com/IQSS/dataverse/issues/4040
18:17 Thalia_UM joined #dataverse
18:17 Thalia_UM Good afternoon Philip
18:18 Thalia_UM I have a question about the Manage Harvesting Server
18:18 Thalia_UM How can I interoperate with another repository?
18:21 pdurbin Thalia_UM: are you trying to harvest data into your Dataverse installation? Or are you trying to allow another system to harvest data from your Dataverse installation?
18:25 Thalia_UM I am trying to allow another system to harvest data from our Dataverse installation
18:36 pdurbin Thalia_UM: ok, you need to create an "OAI Set": http://guides.dataverse.org/en/4.7.1/admin/harvestserver.html
18:36 Thalia_UM Who is that?
18:37 Thalia_UM I already read it, but I don't understand that part
18:38 pdurbin An OAI Set is basically a search query. On that page `keywordValue:censorship` is used as an example.
18:39 Thalia_UM and what is the URL of the harvest server?
18:41 pdurbin I'm confused. Can you please upload a screenshot of what you're looking at to https://imgur.com (or similar)?
18:45 Thalia_UM https://imgur.com/a/ruD5S
18:48 Thalia_UM save the image but leave it on black screen
18:50 Thalia_UM For email??
18:50 pdurbin I can't see the image.
18:51 Thalia_UM Me too, I can't see the image, I upload it, but then leave it on black screen.
18:52 Thalia_UM Me too, I can't see the image, I upload it, but  leave it  black screen.
18:52 pdurbin :(
18:54 Thalia_UM there is a repository that is the client of harvest and to connect us, it asks us the address of the link where is our harvest server
18:57 pdurbin Thalia_UM: that makes sense. Please see this list: "List of Dataverse installation OAI-PMH (Harvesting) URLs" - https://docs.google.com/spreadsheets/d/12cxymvXCqP_kCsLKXQD32go79HBWZ1vU_tdG4kvP5S8/edit?usp=sharing
18:58 Thalia_UM Wowwww that is the URL
18:59 Thalia_UM You are great
19:00 pdurbin yeah, something like https://dataverse.harvard.edu/oai?verb=Identify
19:01 Thalia_UM How does this work? about Manage Harvesting Server, I have to enable this part to use OAI-PMH
19:01 pdurbin Are you finding the user interface for setting up harvesting confusing?
19:08 Thalia_UM I still don't understand how it is that the interoperability of my repository is carried out with the other repository that will harvest the metadata
19:09 pdurbin Well, OAI-PMH is a standard.
19:09 pdurbin I believe that Dataverse is compliant with that standard.
19:10 pdurbin So I think you should be able to give the URL of your Dataverse installation to the people who want to harvest from you.
19:12 Thalia_UM So I just have to share the OAI link?
19:14 pdurbin Yes.
19:14 pdurbin I think. :)
19:15 Thalia_UM :)
19:16 Thalia_UM casually, Do you have worked with something similar where you have to apply interoperability?
19:17 pdurbin Sure. Another standard we support is SWORD.
19:17 Thalia_UM I must also attach 4 web services.
19:18 Thalia_UM What is SOWRD?
19:19 rebecabarros joined #dataverse
19:25 pdurbin Simple Web-service Offering Repository Deposit
19:26 rebecabarros pdurbin: do you guys have some benchmark regarding the ingest process? I upload a stata file (119 mb aprox), with 334 Variables and 109104 Observations. The upload is right away but the ingest (generate the tabular version of the file) it takes more or less 30 minutes.  Is that normal?
19:26 pdurbin Wow, 30 minutes.
19:26 Thalia_UM Is like OAI-PMH??
19:28 pdurbin Thalia_UM: well, both OAI-PMH and SWORD are standards. And they both use XML. But they're pretty different.
19:28 pdurbin rebecabarros: I'm not sure. You might want to ask at https://groups.google.com/forum/#!forum/dataverse-community
19:29 pdurbin rebecabarros: and thanks for opening the "Documentation: Two Ravens installation guide improvement" issue at https://github.com/IQSS/dataverse/issues/4136 !
19:32 Thalia_UM But if it is a protocol for interoperability, isn't it?
19:35 pdurbin Thalia_UM: yes, you can read about SWORD at http://guides.dataverse.org/en/4.7.1/api/sword.html
19:38 rebecabarros pdurbin: Yes, although my server do not have a robust configuration (a little similar with the Phoenix Dataverse), is still a lot of time for such a small file. I will ask in the forum. Thanks again.
19:39 Thalia_UM Thank you Philip
19:39 Thalia_UM But I have to work with OAI-PMH
19:39 pdurbin You're both welcome. I did ask in Slack as well, rebecabarros
19:46 Thalia_UM What is the purpose of enabling OAI server?
19:53 pdurbin So other systems can harvest from you.
19:59 Thalia_UM Extract the metadata to expose the information in a central repository?
20:01 pdurbin Sure, that would be a good reason.
20:02 Thalia_UM Thank you Philip
20:04 Thalia_UM Can i adding web services at dataverse?
20:10 pdurbin I don't understand.
20:14 Thalia_UM Well, I am working with web service that It will return a list of registered users such as name, mail, institution, etc. with format JSON, of kind REST
20:20 pdurbin ok
20:20 pdurbin bjonnh: Can you please take a look at this comment I just made about Docker/OpenShift? https://github.com/IQSS/dataverse/issues/4040#issuecomment-329594934
20:29 Thalia_UM Thank you Philip
20:29 Thalia_UM see you tomorrow
21:41 axfelix joined #dataverse
21:46 axfelix joined #dataverse
21:55 garnett joined #dataverse
21:56 garnett joined #dataverse
21:57 agarnett joined #dataverse

| Channels | #dataverse index | Today | | Search | Google Search | Plain-Text | plain, newest first | summary

Connect via chat.dataverse.org to discuss Dataverse (dataverse.org, an open source web application for sharing, citing, analyzing, and preserving research data) with users and developers.