Solr replication

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Solr replication

Ycrux
Hi !

I'm really new to Solr !

Could anybody please explain me with a short example how I can setup a simple Solr replication with 3 machines (a master node and 2 slaves) ?

This is my conf:

* master (linux 2.6.20) :
- Hostname "solr.master" with IP "192.168.1.1"
* 2 slaves (linux 2.6.20) :
- Hostname "solr.slave1" with IP "192.168.1.2"
- Hostname "solr.slave2" with IP "192.168.1.3"

N.B: sorry if the question was already asked before, but I could't find anything better than the "CollectionDistribution" on the Wiki.

Regards
Y.

Reply | Threaded
Open this post in threaded view
|

I18N with SOLR

Dilip.TS
Hello,

  Is there anyone who has worked on internationalization  with SOLR?
  Apart from using the dynamicField name="*_eng" say for english, is there
any other configurations to be made?

Regards
 Dilip



Reply | Threaded
Open this post in threaded view
|

Re: Solr replication

climbingrose
In reply to this post by Ycrux
1)On solr.master:
+Edit scripts.conf:
solr_hostname=localhost
solr_port=8983
rsyncd_port=18983
+Enable and start rsync:
rsyncd-enable; rsyncd-start
+Run snapshooter:
snapshooter
After running this, you should be able to see a new folder named snapshot.*
in data/index folder.
You can can solrconfig.xml to trigger snapshooter after a commit or
optimise.

2) On slave:
+Edit scripts.conf:
solr_hostname=solr.master
solr_port=8986
rsyncd_port=18986
data_dir=
webapp_name=solr
master_host=localhost
master_data_dir=$MASTER_SOLR_HOME/data/
master_status_dir=$MASTER_SOLR_HOME/logs/clients/
+Run snappuller:
snappuller -P 18983
+Run snapinstaller:
snapinstaller

You should setup crontab to run snappuller and snapinstaller periodically.



On 10/1/07, [hidden email] <[hidden email]> wrote:

>
> Hi !
>
> I'm really new to Solr !
>
> Could anybody please explain me with a short example how I can setup a
> simple Solr replication with 3 machines (a master node and 2 slaves) ?
>
> This is my conf:
>
> * master (linux 2.6.20) :
> - Hostname "solr.master" with IP "192.168.1.1"
> * 2 slaves (linux 2.6.20) :
> - Hostname "solr.slave1" with IP "192.168.1.2"
> - Hostname "solr.slave2" with IP "192.168.1.3"
>
> N.B: sorry if the question was already asked before, but I could't find
> anything better than the "CollectionDistribution" on the Wiki.
>
> Regards
> Y.
>
>


--
Regards,

Cuong Hoang
Reply | Threaded
Open this post in threaded view
|

Re: Re: Solr replication

Ycrux
In reply to this post by Ycrux
Works like a charm. Thanks very much.

cheers
Y.

----Message d'origine----

>Date: Mon, 1 Oct 2007 21:55:30 +1000
>De: climbingrose
>A: [hidden email]
>Sujet: Re: Solr replication
> boundary="----=_Part_10345_13696775.1191239730731"
>
>1)On solr.master:
>+Edit scripts.conf:
>solr_hostname=localhost
>solr_port=8983
>rsyncd_port=18983
>+Enable and start rsync:
>rsyncd-enable; rsyncd-start
>+Run snapshooter:
>snapshooter
>After running this, you should be able to see a new folder named snapshot.*
>in data/index folder.
>You can can solrconfig.xml to trigger snapshooter after a commit or
>optimise.
>
>2) On slave:
>+Edit scripts.conf:
>solr_hostname=solr.master
>solr_port=8986
>rsyncd_port=18986
>data_dir=
>webapp_name=solr
>master_host=localhost
>master_data_dir=$MASTER_SOLR_HOME/data/
>master_status_dir=$MASTER_SOLR_HOME/logs/clients/
>+Run snappuller:
>snappuller -P 18983
>+Run snapinstaller:
>snapinstaller
>
>You should setup crontab to run snappuller and snapinstaller periodically.
>
>
>
>On 10/1/07, [hidden email] <[hidden email]> wrote:
>>
>> Hi !
>>
>> I'm really new to Solr !
>>
>> Could anybody please explain me with a short example how I can setup a
>> simple Solr replication with 3 machines (a master node and 2 slaves) ?
>>
>> This is my conf:
>>
>> * master (linux 2.6.20) :
>> - Hostname "solr.master" with IP "192.168.1.1"
>> * 2 slaves (linux 2.6.20) :
>> - Hostname "solr.slave1" with IP "192.168.1.2"
>> - Hostname "solr.slave2" with IP "192.168.1.3"
>>
>> N.B: sorry if the question was already asked before, but I could't find
>> anything better than the "CollectionDistribution" on the Wiki.
>>
>> Regards
>> Y.
>>
>>
>
>
>--
>Regards,
>
>Cuong Hoang
>
>

Reply | Threaded
Open this post in threaded view
|

Re: Re: Re: Solr replication

Ycrux
In reply to this post by Ycrux
One more question about replication.

Now that the replication is working, how can I see the changes on slave nodes ?

The page statistics :

"http://solr.slave1:8983/solr/admin/stats.jsp"

doesn't reflect the correct number of indexed documents and still shows numDocs=0.

Is there any command to tell Solr (on slave node) to sync itself with
disk ?

cheers
Y.

----Message d'origine----

>De: [hidden email]
>A: [hidden email]
>Sujet: Re: Re: Solr replication
>Date: Mon,  1 Oct 2007 15:00:46 +0200
>
>Works like a charm. Thanks very much.
>
>cheers
>Y.
>
>----Message d'origine----
>>Date: Mon, 1 Oct 2007 21:55:30 +1000
>>De: climbingrose
>>A: [hidden email]
>>Sujet: Re: Solr replication
>> boundary="----=_Part_10345_13696775.1191239730731"
>>
>>1)On solr.master:
>>+Edit scripts.conf:
>>solr_hostname=localhost
>>solr_port=8983
>>rsyncd_port=18983
>>+Enable and start rsync:
>>rsyncd-enable; rsyncd-start
>>+Run snapshooter:
>>snapshooter
>>After running this, you should be able to see a new folder named snapshot.*
>>in data/index folder.
>>You can can solrconfig.xml to trigger snapshooter after a commit or
>>optimise.
>>
>>2) On slave:
>>+Edit scripts.conf:
>>solr_hostname=solr.master
>>solr_port=8986
>>rsyncd_port=18986
>>data_dir=
>>webapp_name=solr
>>master_host=localhost
>>master_data_dir=$MASTER_SOLR_HOME/data/
>>master_status_dir=$MASTER_SOLR_HOME/logs/clients/
>>+Run snappuller:
>>snappuller -P 18983
>>+Run snapinstaller:
>>snapinstaller
>>
>>You should setup crontab to run snappuller and snapinstaller periodically.
>>
>>
>>
>>On 10/1/07, [hidden email] <[hidden email]> wrote:
>>>
>>> Hi !
>>>
>>> I'm really new to Solr !
>>>
>>> Could anybody please explain me with a short example how I can setup a
>>> simple Solr replication with 3 machines (a master node and 2 slaves) ?
>>>
>>> This is my conf:
>>>
>>> * master (linux 2.6.20) :
>>> - Hostname "solr.master" with IP "192.168.1.1"
>>> * 2 slaves (linux 2.6.20) :
>>> - Hostname "solr.slave1" with IP "192.168.1.2"
>>> - Hostname "solr.slave2" with IP "192.168.1.3"
>>>
>>> N.B: sorry if the question was already asked before, but I could't find
>>> anything better than the "CollectionDistribution" on the Wiki.
>>>
>>> Regards
>>> Y.
>>>
>>>
>>
>>
>>--
>>Regards,
>>
>>Cuong Hoang
>>
>>
>

Reply | Threaded
Open this post in threaded view
|

Re: Re: Re: Solr replication

climbingrose
sh /bin/commit should trigger a refresh. However, this command should be
executed as part of snapinstaller so you should have to run it manually.

On 10/1/07, [hidden email] <[hidden email]> wrote:

>
> One more question about replication.
>
> Now that the replication is working, how can I see the changes on slave
> nodes ?
>
> The page statistics :
>
> "http://solr.slave1:8983/solr/admin/stats.jsp"
>
> doesn't reflect the correct number of indexed documents and still shows
> numDocs=0.
>
> Is there any command to tell Solr (on slave node) to sync itself with
> disk ?
>
> cheers
> Y.
>
> ----Message d'origine----
> >De: [hidden email]
> >A: [hidden email]
> >Sujet: Re: Re: Solr replication
> >Date: Mon,  1 Oct 2007 15:00:46 +0200
> >
> >Works like a charm. Thanks very much.
> >
> >cheers
> >Y.
> >
> >----Message d'origine----
> >>Date: Mon, 1 Oct 2007 21:55:30 +1000
> >>De: climbingrose
> >>A: [hidden email]
> >>Sujet: Re: Solr replication
> >>      boundary="----=_Part_10345_13696775.1191239730731"
> >>
> >>1)On solr.master:
> >>+Edit scripts.conf:
> >>solr_hostname=localhost
> >>solr_port=8983
> >>rsyncd_port=18983
> >>+Enable and start rsync:
> >>rsyncd-enable; rsyncd-start
> >>+Run snapshooter:
> >>snapshooter
> >>After running this, you should be able to see a new folder named
> snapshot.*
> >>in data/index folder.
> >>You can can solrconfig.xml to trigger snapshooter after a commit or
> >>optimise.
> >>
> >>2) On slave:
> >>+Edit scripts.conf:
> >>solr_hostname=solr.master
> >>solr_port=8986
> >>rsyncd_port=18986
> >>data_dir=
> >>webapp_name=solr
> >>master_host=localhost
> >>master_data_dir=$MASTER_SOLR_HOME/data/
> >>master_status_dir=$MASTER_SOLR_HOME/logs/clients/
> >>+Run snappuller:
> >>snappuller -P 18983
> >>+Run snapinstaller:
> >>snapinstaller
> >>
> >>You should setup crontab to run snappuller and snapinstaller
> periodically.
> >>
> >>
> >>
> >>On 10/1/07, [hidden email] <[hidden email]> wrote:
> >>>
> >>> Hi !
> >>>
> >>> I'm really new to Solr !
> >>>
> >>> Could anybody please explain me with a short example how I can setup a
> >>> simple Solr replication with 3 machines (a master node and 2 slaves) ?
> >>>
> >>> This is my conf:
> >>>
> >>> * master (linux 2.6.20) :
> >>> - Hostname "solr.master" with IP "192.168.1.1"
> >>> * 2 slaves (linux 2.6.20) :
> >>> - Hostname "solr.slave1" with IP "192.168.1.2"
> >>> - Hostname "solr.slave2" with IP "192.168.1.3"
> >>>
> >>> N.B: sorry if the question was already asked before, but I could't
> find
> >>> anything better than the "CollectionDistribution" on the Wiki.
> >>>
> >>> Regards
> >>> Y.
> >>>
> >>>
> >>
> >>
> >>--
> >>Regards,
> >>
> >>Cuong Hoang
> >>
> >>
> >
>
>


--
Regards,

Cuong Hoang
Reply | Threaded
Open this post in threaded view
|

Re: Re: Re: Re: Solr replication

Ycrux
In reply to this post by Ycrux
Perfect. Thanks for all guys.

cheers
Y.

----Message d'origine----

>Date: Tue, 2 Oct 2007 01:01:37 +1000
>De: climbingrose
>A: [hidden email]
>Sujet: Re: Re: Re: Solr replication
> boundary="----=_Part_11644_22377225.1191250897674"
>
>sh /bin/commit should trigger a refresh. However, this command should be
>executed as part of snapinstaller so you should have to run it manually.
>
>On 10/1/07, [hidden email] <[hidden email]> wrote:
>>
>> One more question about replication.
>>
>> Now that the replication is working, how can I see the changes on slave
>> nodes ?
>>
>> The page statistics :
>>
>> "http://solr.slave1:8983/solr/admin/stats.jsp"
>>
>> doesn't reflect the correct number of indexed documents and still shows
>> numDocs=0.
>>
>> Is there any command to tell Solr (on slave node) to sync itself with
>> disk ?
>>
>> cheers
>> Y.
>>
>> ----Message d'origine----
>> >De: [hidden email]
>> >A: [hidden email]
>> >Sujet: Re: Re: Solr replication
>> >Date: Mon,  1 Oct 2007 15:00:46 +0200
>> >
>> >Works like a charm. Thanks very much.
>> >
>> >cheers
>> >Y.
>> >
>> >----Message d'origine----
>> >>Date: Mon, 1 Oct 2007 21:55:30 +1000
>> >>De: climbingrose
>> >>A: [hidden email]
>> >>Sujet: Re: Solr replication
>> >>      boundary="----=_Part_10345_13696775.1191239730731"
>> >>
>> >>1)On solr.master:
>> >>+Edit scripts.conf:
>> >>solr_hostname=localhost
>> >>solr_port=8983
>> >>rsyncd_port=18983
>> >>+Enable and start rsync:
>> >>rsyncd-enable; rsyncd-start
>> >>+Run snapshooter:
>> >>snapshooter
>> >>After running this, you should be able to see a new folder named
>> snapshot.*
>> >>in data/index folder.
>> >>You can can solrconfig.xml to trigger snapshooter after a commit or
>> >>optimise.
>> >>
>> >>2) On slave:
>> >>+Edit scripts.conf:
>> >>solr_hostname=solr.master
>> >>solr_port=8986
>> >>rsyncd_port=18986
>> >>data_dir=
>> >>webapp_name=solr
>> >>master_host=localhost
>> >>master_data_dir=$MASTER_SOLR_HOME/data/
>> >>master_status_dir=$MASTER_SOLR_HOME/logs/clients/
>> >>+Run snappuller:
>> >>snappuller -P 18983
>> >>+Run snapinstaller:
>> >>snapinstaller
>> >>
>> >>You should setup crontab to run snappuller and snapinstaller
>> periodically.
>> >>
>> >>
>> >>
>> >>On 10/1/07, [hidden email] <[hidden email]> wrote:
>> >>>
>> >>> Hi !
>> >>>
>> >>> I'm really new to Solr !
>> >>>
>> >>> Could anybody please explain me with a short example how I can setup a
>> >>> simple Solr replication with 3 machines (a master node and 2 slaves) ?
>> >>>
>> >>> This is my conf:
>> >>>
>> >>> * master (linux 2.6.20) :
>> >>> - Hostname "solr.master" with IP "192.168.1.1"
>> >>> * 2 slaves (linux 2.6.20) :
>> >>> - Hostname "solr.slave1" with IP "192.168.1.2"
>> >>> - Hostname "solr.slave2" with IP "192.168.1.3"
>> >>>
>> >>> N.B: sorry if the question was already asked before, but I could't
>> find
>> >>> anything better than the "CollectionDistribution" on the Wiki.
>> >>>
>> >>> Regards
>> >>> Y.
>> >>>
>> >>>
>> >>
>> >>
>> >>--
>> >>Regards,
>> >>
>> >>Cuong Hoang
>> >>
>> >>
>> >
>>
>>
>
>
>--
>Regards,
>
>Cuong Hoang
>
>