CDCR one source multiple targets

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

CDCR one source multiple targets

gnandre
Hi,

is it possible to use CDCR with one source SolrCloud cluster and multiple
target SolrCloud clusters? I tried to edit the zkHost setting in source
cluster's solrconfig file by adding multiple comma separated values for
target zkhosts for multuple target clusters. But the CDCR replication
happens only to one of the zkhosts and not all. If this is not supported
then how should I go about implementing something like this?
Reply | Threaded
Open this post in threaded view
|

Re: CDCR one source multiple targets

gnandre
I see a similar question asked but no answers there too.
http://lucene.472066.n3.nabble.com/CDCR-Replication-from-one-source-to-multiple-targets-td4308717.html
OP there is using multiple cdcr request handlers but in my case I am using
multiple zkhost strings. It will be pretty limiting if we cannot use cdcr
for one source- multiple target cluster situation.
Can somebody please confirm whether this is even supported?


On Wed, Mar 20, 2019 at 1:12 PM Arnold Bronley <[hidden email]>
wrote:

> Hi,
>
> is it possible to use CDCR with one source SolrCloud cluster and multiple
> target SolrCloud clusters? I tried to edit the zkHost setting in source
> cluster's solrconfig file by adding multiple comma separated values for
> target zkhosts for multuple target clusters. But the CDCR replication
> happens only to one of the zkhosts and not all. If this is not supported
> then how should I go about implementing something like this?
>
>
Reply | Threaded
Open this post in threaded view
|

Re: CDCR one source multiple targets

gnandre
This had a very simple solution if anybody else is wondering about the same
issue.I had to define separate replica elements inside cdcr. Following is
an example.

<requestHandler name="/cdcr" class="solr.CdcrRequestHandler"> <lst name=
"replica"> <str name="zkHost">target1:2181</str> <!-- If you have chrooted
your Solr information at the target you must include the chroot, for
example: <str name="zkHost">10.240.18.211:2181,10.240.18.212:2181/solr</str>
--> <str name="source">techproducts</str> <str name="target">techproducts</
str> </lst> <lst name="replica"> <str name="zkHost">target2:2181</str> <!--
If you have chrooted your Solr information at the target you must include
the chroot, for example: <str name="zkHost">10.240.18.211:2181,
10.240.18.212:2181/solr</str> --> <str name="source">techproducts</str> <str
name="target">techproducts</str> </lst> <lst name="replicator"> <str name=
"threadPoolSize">8</str> <str name="schedule">1000</str> <str name=
"batchSize">128</str> </lst> <lst name="updateLogSynchronizer"> <str name=
"schedule">1000</str> </lst> <!-- recommended for Target clusters --> <lst
name="buffer"> <str name="defaultState">disabled</str> </lst> </
requestHandler>

On Thu, Mar 21, 2019 at 10:40 AM Arnold Bronley <[hidden email]>
wrote:

> I see a similar question asked but no answers there too.
> http://lucene.472066.n3.nabble.com/CDCR-Replication-from-one-source-to-multiple-targets-td4308717.html
> OP there is using multiple cdcr request handlers but in my case I am using
> multiple zkhost strings. It will be pretty limiting if we cannot use cdcr
> for one source- multiple target cluster situation.
> Can somebody please confirm whether this is even supported?
>
>
> On Wed, Mar 20, 2019 at 1:12 PM Arnold Bronley <[hidden email]>
> wrote:
>
>> Hi,
>>
>> is it possible to use CDCR with one source SolrCloud cluster and multiple
>> target SolrCloud clusters? I tried to edit the zkHost setting in source
>> cluster's solrconfig file by adding multiple comma separated values for
>> target zkhosts for multuple target clusters. But the CDCR replication
>> happens only to one of the zkhosts and not all. If this is not supported
>> then how should I go about implementing something like this?
>>
>>
>
Reply | Threaded
Open this post in threaded view
|

Re: CDCR one source multiple targets

Amrit Sarkar
Thanks, Arnold,

Is the documentation not clear with the manner multiple CDCR targets can be
configured?

Amrit Sarkar
Search Engineer
Lucidworks, Inc.
415-589-9269
www.lucidworks.com
Twitter http://twitter.com/lucidworks
LinkedIn: https://www.linkedin.com/in/sarkaramrit2
Medium: https://medium.com/@sarkaramrit2


On Thu, Apr 11, 2019 at 2:59 AM Arnold Bronley <[hidden email]>
wrote:

> This had a very simple solution if anybody else is wondering about the same
> issue.I had to define separate replica elements inside cdcr. Following is
> an example.
>
> <requestHandler name="/cdcr" class="solr.CdcrRequestHandler"> <lst name=
> "replica"> <str name="zkHost">target1:2181</str> <!-- If you have chrooted
> your Solr information at the target you must include the chroot, for
> example: <str name="zkHost">10.240.18.211:2181,10.240.18.212:2181/solr
> </str>
> --> <str name="source">techproducts</str> <str name="target">techproducts</
> str> </lst> <lst name="replica"> <str name="zkHost">target2:2181</str> <!--
> If you have chrooted your Solr information at the target you must include
> the chroot, for example: <str name="zkHost">10.240.18.211:2181,
> 10.240.18.212:2181/solr</str> --> <str name="source">techproducts</str>
> <str
> name="target">techproducts</str> </lst> <lst name="replicator"> <str name=
> "threadPoolSize">8</str> <str name="schedule">1000</str> <str name=
> "batchSize">128</str> </lst> <lst name="updateLogSynchronizer"> <str name=
> "schedule">1000</str> </lst> <!-- recommended for Target clusters --> <lst
> name="buffer"> <str name="defaultState">disabled</str> </lst> </
> requestHandler>
>
> On Thu, Mar 21, 2019 at 10:40 AM Arnold Bronley <[hidden email]>
> wrote:
>
> > I see a similar question asked but no answers there too.
> >
> http://lucene.472066.n3.nabble.com/CDCR-Replication-from-one-source-to-multiple-targets-td4308717.html
> > OP there is using multiple cdcr request handlers but in my case I am
> using
> > multiple zkhost strings. It will be pretty limiting if we cannot use cdcr
> > for one source- multiple target cluster situation.
> > Can somebody please confirm whether this is even supported?
> >
> >
> > On Wed, Mar 20, 2019 at 1:12 PM Arnold Bronley <[hidden email]>
> > wrote:
> >
> >> Hi,
> >>
> >> is it possible to use CDCR with one source SolrCloud cluster and
> multiple
> >> target SolrCloud clusters? I tried to edit the zkHost setting in source
> >> cluster's solrconfig file by adding multiple comma separated values for
> >> target zkhosts for multuple target clusters. But the CDCR replication
> >> happens only to one of the zkhosts and not all. If this is not supported
> >> then how should I go about implementing something like this?
> >>
> >>
> >
>