Time
S
Nick
Message
00:18 djbrooke joined #dataverse
00:21 garnett joined #dataverse
01:17 djbrooke joined #dataverse
02:16 djbrooke joined #dataverse
02:31 djbrooke joined #dataverse
02:34 djbrooke joined #dataverse
03:23 michbarsinai joined #dataverse
04:09 michbarsinai joined #dataverse
04:39 garnett joined #dataverse
05:05 djbrooke joined #dataverse
05:08 michbars1 joined #dataverse
07:33 soU joined #dataverse
07:39 djbrooke joined #dataverse
08:28 andrewSC joined #dataverse
09:39 soU joined #dataverse
10:33 soU joined #dataverse
11:42 djbrooke joined #dataverse
12:07 soU joined #dataverse
12:52 andrewSC joined #dataverse
13:35 cdsp-rmo joined #dataverse
13:39 cdsp-rmo
hello world
13:40 cdsp-rmo
I'm trying to find some help with OAi servers definition queries
13:41 cdsp-rmo
I did a request that should list all datasets from a particular dataverse, but it seems that with the argument alone, nothing's available :(
13:42 cdsp-rmo
for example, here is the OAI serveur definition query
13:42 cdsp-rmo
dvName:ArchiPolis title:*
13:42 cdsp-rmo
result is here
13:42 cdsp-rmo
https://catalogues.cdsp.sciences-po.fr/oai?verb=ListRecords&metadataPrefix=oai_dc&set=ArchiPolis
13:42 cdsp-rmo
(ArchiPolis is also the name of the OAi server)
13:44 cdsp-rmo
the second server is "testDate", with this query : dvName:ArchiPolis
13:45 cdsp-rmo
the gui says that no datasets are found for this one :S
13:45 cdsp-rmo
but it should be the same request, right ?
13:45 donsizemore joined #dataverse
13:53 pdurbin
cdsp-rmo: you want all the children of https://catalogues.cdsp.sciences-po.fr/dataverse/archipolis ?
13:54 cdsp-rmo
no, I'm trying to get some dataverse separately
13:54 cdsp-rmo
for example, I got a dataverse named triangle
13:54 cdsp-rmo
I'd like to get all the datasets of this particular dataverse
13:54 cdsp-rmo
so I tried dvName:triangle
13:55 cdsp-rmo
but the result is a No records (empty set)
13:55 cdsp-rmo
(and the result for this set doesn't change also)
13:55 cdsp-rmo
(like if it kept the previous one because new one is empty)
13:55 pdurbin
Can you get the Dataverse GUI to return the results you want?
13:56 cdsp-rmo
the manage harvesting server indicate that no datasets were found
13:56 cdsp-rmo
*the manage harvesting server interface
13:58 pdurbin
What I'm trying to say is that if you can get the Dataverse GUI to return the results you want (or the Search API ) you should be able to use that query to define an OAI set.
14:00 cdsp-rmo
https://catalogues.cdsp.sciences-po.fr/dataverse/data?q=dvName%3Atriangle
14:00 cdsp-rmo
like this ?
14:00 pdurbin
but that doesn't return any datasets
14:01 cdsp-rmo
yeah, that may be the problem
14:01 pdurbin
that's what I'm trying to say :)
14:01 cdsp-rmo
hum
14:01 pdurbin
If you can get the GUI to return what you want, you'll be closer to a solution.
14:01 cdsp-rmo
ok, I didn't tought they had the same "query" working way
14:03 cdsp-rmo
it seems you can't indicate the dataverse parent, or dunoo how to do that
14:04 pdurbin
If you want "triangle" to be the parent, try your search from https://catalogues.cdsp.sciences-po.fr/dataverse/triangle
14:05 pdurbin
The Search API equivalent is "subtree=triangle" per http://guides.dataverse.org/en/4.6/api/search.html#parameters
14:07 cdsp-rmo
subtree seems to not be accepted by the oai server
14:07 cdsp-rmo
Search Syntax Error: undefined field subtree
14:07 pdurbin
yeah, I know :(
14:07 pdurbin
oh, wait
14:07 cdsp-rmo
:o
14:09 pdurbin
So, here's the difference... the GUI and the Search API allow you to use what the Search API calls "fq" for filter queries. Filter queries are a way of narrowing down an original query (clicking a facet). The OAI set only allows query. You can't add filter queries. (Saved Search supports both query and filter queries too.)
14:10 pdurbin
So you need to figure out how to put it all in a single query... your OAI set definition.
14:12 cdsp-rmo
hum
14:14 pdurbin
I'm looking at https://catalogues.cdsp.sciences-po.fr/api/dataverses/archipolis/contents to figure out the id of your Triangle dataverse, which seems to be 79.
14:15 cdsp-rmo
oh
14:15 cdsp-rmo
ParentId
14:15 cdsp-rmo
this works
14:16 cdsp-rmo
*parentId
14:16 cdsp-rmo
with the given id
14:16 pdurbin
and ArchiPolis is 40
14:18 cdsp-rmo
hum
14:18 pdurbin
so try searching for this: subtreePaths:"/40/79"
14:18 pdurbin
https://catalogues.cdsp.sciences-po.fr/dataverse/data?q=subtreePaths%3A%22%2F40%2F79%22
14:18 cdsp-rmo
giving this
14:18 cdsp-rmo
parentId:75 parentId:79
14:18 cdsp-rmo
ah
14:18 cdsp-rmo
parentId:79 works alone too
14:19 pdurbin
whatever works! ;)
14:19 cdsp-rmo
^
14:19 cdsp-rmo
hum
14:19 cdsp-rmo
wait, I don't understand
14:19 cdsp-rmo
the result doesn't change ?
14:20 cdsp-rmo
here is the set
14:20 cdsp-rmo
https://catalogues.cdsp.sciences-po.fr/oai?verb=ListRecords&metadataPrefix=oai_dc&set=testDate
14:20 cdsp-rmo
I got way more results than what the oai server says
14:20 cdsp-rmo
15 datasets (15 records exported, 185 marked as deleted)
14:21 cdsp-rmo
oh, I see
14:21 cdsp-rmo
it keeps the datasets, but mark them as "deleted" ?
14:22 cdsp-rmo
(in the status header field)
14:23 cdsp-rmo
your syntax is better
14:23 cdsp-rmo
it only returns the datasets, not the "deleted"(?) ones
14:24 cdsp-rmo
https://catalogues.cdsp.sciences-po.fr/oai?verb=ListRecords&metadataPrefix=oai_dc&set=otherTest
14:25 cdsp-rmo
strange mecanics the "deleted" thing
14:30 pdurbin
Dataverse sometimes moves in mysterious ways ;)
14:33 cdsp-rmo
^^
14:33 cdsp-rmo
thanks a lot for your help
14:37 pdurbin
oh sure
14:37 pdurbin
this stuff is confusing
14:39 pdurbin
For Saved Search we decided to re-use regular search and facet GUI to define the Saved Search. But for Harvesting you have to decide what to type in a box called 'query' or whatever. It's harder. Or at least, you'd better have a good plan of what you want to type in that box. :)
14:46 michbars1 joined #dataverse
15:20 djbrooke joined #dataverse
15:21 djbrooke_ joined #dataverse
15:22 djbrooke joined #dataverse
15:23 pameyer joined #dataverse
15:26 djbrooke joined #dataverse
15:47 donsizemore joined #dataverse
15:49 djbrooke joined #dataverse
15:54 djbrooke joined #dataverse
16:15 djbrooke joined #dataverse
16:50 soU joined #dataverse
16:55 axfelix joined #dataverse
16:57 axfelix joined #dataverse
17:43 pdurbin1 joined #dataverse
18:03 djbrooke joined #dataverse
18:30 michbars1 joined #dataverse
18:44 donsizemore joined #dataverse
19:47 djbrooke joined #dataverse
19:51 djbrooke joined #dataverse
20:07 djbrooke joined #dataverse
20:29 michbars1 joined #dataverse
20:42 soU joined #dataverse
20:48 djbrooke joined #dataverse
21:04 soU joined #dataverse
21:25 pdurbin left #dataverse
21:37 djbrooke joined #dataverse
21:44 yoh joined #dataverse
22:34 axfelix joined #dataverse
