Time
S
Nick
Message
01:32 bjonnh joined #dataverse
05:16 axfelix joined #dataverse
06:28 teya joined #dataverse
07:51 teya
hello pdurbin: as we discussed i was thinking upgrading to version 4 inorderto use solr but i learnt that v4 doesn't support handles or you can't create new one. so this will serve my need i guess http://guides.dataverse.org/en/3.6.2/dataverse-api-main.html cause it says "As of version 3.0, a new API for programmatic access to the DVN data and metadata has been added. The API allows a remote, non-DVN archive/application to search the holdings and download fi
07:51 teya
les from a Dataverse Network." which i am looking for ... accessing the content from remote solr instant
07:54 teya
what i want for now is not integrate DVN with solr rather there is a DVN v 3.0 with around 1k data. and i have solr instant on different server which index or bring indexed data from different remote systems. so i want to include my DVN in it.
07:55 teya
so from the site above i tried to run "/dvn/api/metadataSearchFields/" but am getting 503 error service not found
08:08 teya
addition to that pdurbin: u mention that v3.x uses lucene is there anyway i can access some kind of gui of it? as we do on solr via the port 8983??
08:54 teya joined #dataverse
09:07 teya joined #dataverse
09:23 teya joined #dataverse
09:36 teya joined #dataverse
12:05 donsizemore joined #dataverse
13:01 pdurbin
yesteray we talked about how Handle support is coming: https://groups.google.com/d/msg/dataverse-community/tDjFfGQ-f0Q/EhEVDVzMAQAJ
13:01 pdurbin
yesterday*
13:06 pdurbin
I wouldn't build anything on top of that "metadataSearchFields" endpoint that's part of the old DVN 3.x "Data Sharing API " ( http://guides.dataverse.org/en/3.6.2/dataverse-api-main.html#data-sharing-api ) because we decided to drop that API in Dataverse 4.0. It doesn't exist anymore. There are better APIs to use instead.
13:07 pdurbin
In fact, the only API we carried forward from DVN 3.x to Dataverse 4 is the SWORD API: https://github.com/IQSS/dataverse/issues/780
13:22 teya joined #dataverse
13:31 teya
pdurbin: until handle support is here i have to stay at 3.0 and as i said on the previous message is there anyways i can access the lucene indexed data? so that i'll configure my solr on the remote server to fetch from it. something like this http://stackoverflow.com/questions/2715973/can-a-raw-lucene-index-be-loaded-by-solr
13:33 pdurbin
teya: hi! Did you see what I wrote earlier this morning? http://irclog.iq.harvard.edu/dataverse/2016-10-26#i_43748
13:33 teya
yes i did
13:34 teya
handle support is coming..
13:34 pdurbin
yeah :)
13:34 pdurbin
teya: I wouldn't recommend touching the lucene files on disk but I can tell you where they are if you want. :)
13:35 teya
that's grate but it is not there yet right?
13:35 teya
so what i planned for the time bing is ...
13:36 pdurbin
teya: right. If you look at https://waffle.io/IQSS/dataverse you'll see that Handle support (issue 2437) is currently in QA.
13:36 teya
right some script to copy the lucene file into the other remote solr server and read it via the solr
13:39 teya
that's what i plan for the time bing
13:41 teya
so where can i access the lucene file
13:45 pameyer joined #dataverse
13:49 teya
pdurbin: would u provide me the address for the lucene files on disk. as i told u i'll work on the copy
13:51 bricas
pdurbin: crap. i missed the call yesterday -- still, i've not been able to get to the metrics stuff in our WG meetings. soon, i hope.
13:52 bricas
pdurbin: i do have another small question though: if we ever wanted to change our files location, is that as simple as moving everything from the current folder to the new one and changing the config var?
13:54 djbrooke joined #dataverse
13:58 pdurbin
teya: I'm looking. It's been a while since I hacked on DVN 3.x. :)
13:58 teya
oh ok, take your time
14:01 * pdurbin
looks at an ancient DVN 3.x commit: start lucene faceting branch · IQSS/dvnhttps://github.com/IQSS/dvn/commit/37a48687309fb47d9c38dd6fc6629e26154fecdd
14:02 pdurbin
teya: ah, yes, good old "index-dif" and "taxo-dir". Do you see directories on your filesystem with these names?
14:02 pdurbin
whooops! "index-dir"
14:05 teya
/opt/glassfish3/glassfish/domains/dataverse/config/index-dir
14:06 pdurbin
teya: BOOM! Good find.
14:07 pdurbin
bricas: I assume you found http://guides.dataverse.org/en/4.5.1/installation/config.html#dataverse-files-directory
14:24 bricas
pdurbin: yep. that would be the "config var" part.
14:26 pdurbin
bricas: should work but I haven't tried it myself.
14:26 pdurbin
bricas: if it doesn't work, please open a GitHub issue :)
14:27 bricas
pdurbin: hoping i don't have to use it for some time :)
14:28 pdurbin
measure twice, cut once
14:30 bricas
"how much space do we need?" "i dunno, how much space can we have?" etc etc
14:32 teya
pdurbin , if u have knowhow on solr, should i copied everything in dataverse/config/index-dir into solr/data/index? or some specific file only ? incase if u got an idea..
14:33 teya
on the link i sent from stackoverflow it says Copied pre-existing Lucene index files to /usr/local/solr/data/index and its was successful
14:33 pdurbin
teya: sorry, I have no idea. I treat Solr like a black box. I only interact with it by shoving JSON in and getting JSON out.
14:33 teya
oh ok, :)
14:33 pdurbin
teya: there's a channel on freenode called #solr where you can ask. If you figure out what to do, please report back here! :)
14:34 teya
ok will do!
14:34 pdurbin
thanks
14:35 teya
just to confirm, using solr is started from v 4.0 right? and do u think it going take much time until 4.x start support handle..?
14:38 pdurbin
djbrooke: do you have a sense of this?
14:42 pdurbin
teya: I just left a comment at https://github.com/IQSS/dataverse/issues/2437#issuecomment-256367170 to say you're interested. Is your Dataverse installation on the map at http://dataverse.org ?
14:49 djbrooke joined #dataverse
14:50 teya joined #dataverse
14:50 djbrooke
Hi Teya - we're planning on delivering Handle support as part of 4.6, which we plan to deliver by the end of the year
14:51 teya
Thank you djbrooke
14:52 teya
is using solr started since 4.0 or 3.6 uses solr?
14:52 pdurbin
teya: I added Solr to Dataverse in 4.0.
14:54 teya
oh ok its just because yesterday <donsizemore> mention about 3.6. Thank you for the clarity
14:56 pdurbin
3.6 is becoming a distant memory for donsizemore :)
14:57 donsizemore
@pdurbin i just shut down our 3.6-test and 3.6-patchtest machines this morning =)
14:57 donsizemore
@teya i was confused about that, sorry. you should generally ignore anything i say =)
14:59 pdurbin
however, you *should* listen to anything donsizemore has to say about https://github.com/IQSS/dataverse-ansible :)
15:01 teya
:) pdurbin i know!!
15:01 teya
thank you so much all, talk to u later
15:13 pdurbin
donsizemore bricas djbrooke: please remind me to find out which installation of Dataverse teya runs and if it's on the map or not.
15:51 donsizemore joined #dataverse
16:01 axfelix joined #dataverse
17:15 djbrooke joined #dataverse
17:20 djbrooke joined #dataverse
17:32 donsizemore joined #dataverse
18:03 axfelix joined #dataverse
18:06 djbrooke joined #dataverse
18:23 djbrooke joined #dataverse
18:34 dataverse-user joined #dataverse
18:34 dataverse-user left #dataverse
18:35 pcharoen joined #dataverse
18:35 pcharoen39 joined #dataverse
19:05 axfelix joined #dataverse
19:17 djbrooke joined #dataverse
20:16 djbrooke joined #dataverse
20:46 djbrooke joined #dataverse
21:14 djbrooke joined #dataverse
21:40 donsizemore joined #dataverse
22:42 axfelix joined #dataverse
22:52 djbrooke joined #dataverse
23:43 djbrooke joined #dataverse
