Solr background merge in case of pull replicas

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Solr background merge in case of pull replicas

kshitij tyagi-2
Hi,

I am having a  tlog + pull replica solr cloud setup.

1. I am observing that whenever background segment merge is triggered
automatically, i see high response time on all of my solr nodes.

As far as I know merges must be happening on tlog and hence the increase
response time, i am not able to understand that why my pull replicas are
affected during background index merges.

Can someone give some insights on this? What is affecting my pull replicas
during index merges?

Regards,
kshitij
Reply | Threaded
Open this post in threaded view
|

Re: Solr background merge in case of pull replicas

ritvik
Hi
It may be the cause of rebalancing and querying is not available not on
tlog at that moment.
You can check tlog logs and pull log when u are facing this issue.

May i know which version of solr you are using? and what is the ration of
tlog and pull nodes.

On Wed, 6 Jan 2021 at 2:46 PM, kshitij tyagi <[hidden email]> wrote:

> Hi,
>
> I am having a  tlog + pull replica solr cloud setup.
>
> 1. I am observing that whenever background segment merge is triggered
> automatically, i see high response time on all of my solr nodes.
>
> As far as I know merges must be happening on tlog and hence the increase
> response time, i am not able to understand that why my pull replicas are
> affected during background index merges.
>
> Can someone give some insights on this? What is affecting my pull replicas
> during index merges?
>
> Regards,
> kshitij
>
Reply | Threaded
Open this post in threaded view
|

Re: Solr background merge in case of pull replicas

kshitij tyagi-2
Hi,

I am not querying on tlog replicas, solr version is 8.6 and 2 tlogs and 4
pull replica setup.

why should pull replicas be affected during background segment merges?

Regards,
kshitij

On Wed, Jan 6, 2021 at 9:48 PM Ritvik Sharma <[hidden email]> wrote:

> Hi
> It may be the cause of rebalancing and querying is not available not on
> tlog at that moment.
> You can check tlog logs and pull log when u are facing this issue.
>
> May i know which version of solr you are using? and what is the ration of
> tlog and pull nodes.
>
> On Wed, 6 Jan 2021 at 2:46 PM, kshitij tyagi <[hidden email]>
> wrote:
>
> > Hi,
> >
> > I am having a  tlog + pull replica solr cloud setup.
> >
> > 1. I am observing that whenever background segment merge is triggered
> > automatically, i see high response time on all of my solr nodes.
> >
> > As far as I know merges must be happening on tlog and hence the increase
> > response time, i am not able to understand that why my pull replicas are
> > affected during background index merges.
> >
> > Can someone give some insights on this? What is affecting my pull
> replicas
> > during index merges?
> >
> > Regards,
> > kshitij
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Solr background merge in case of pull replicas

Abhishek Mishra
Hi Kshitij

What I can guess over here. Pull replicas replicate segments from tlog, so
whenever merge happens on tlog it will decrease the number of segments
which is more than ideal case(i.e. adding a new segment). Afaik
adding/deleting the segment is kind of a stop the world moment. This can be
the reason for the increase in response time.

Regards,
Abhishek

On Thu, Jan 7, 2021 at 12:43 PM kshitij tyagi <[hidden email]>
wrote:

> Hi,
>
> I am not querying on tlog replicas, solr version is 8.6 and 2 tlogs and 4
> pull replica setup.
>
> why should pull replicas be affected during background segment merges?
>
> Regards,
> kshitij
>
> On Wed, Jan 6, 2021 at 9:48 PM Ritvik Sharma <[hidden email]>
> wrote:
>
> > Hi
> > It may be the cause of rebalancing and querying is not available not on
> > tlog at that moment.
> > You can check tlog logs and pull log when u are facing this issue.
> >
> > May i know which version of solr you are using? and what is the ration of
> > tlog and pull nodes.
> >
> > On Wed, 6 Jan 2021 at 2:46 PM, kshitij tyagi <[hidden email]>
> > wrote:
> >
> > > Hi,
> > >
> > > I am having a  tlog + pull replica solr cloud setup.
> > >
> > > 1. I am observing that whenever background segment merge is triggered
> > > automatically, i see high response time on all of my solr nodes.
> > >
> > > As far as I know merges must be happening on tlog and hence the
> increase
> > > response time, i am not able to understand that why my pull replicas
> are
> > > affected during background index merges.
> > >
> > > Can someone give some insights on this? What is affecting my pull
> > replicas
> > > during index merges?
> > >
> > > Regards,
> > > kshitij
> > >
> >
>