Query takes more time in Solr 8.5.1 compare to 6.1.0 version

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

Query takes more time in Solr 8.5.1 compare to 6.1.0 version

jay harkhani
Hello,

Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.

Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).

Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view

Logs and Thread dump stack trace
Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view

To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?

Can someone please help to isolate this issue.

Regards,
Jay Harkhani.
Reply | Threaded
Open this post in threaded view
|

Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

vishal patel-2
Any one is looking this issue?
I got same issue.

Regards,
Vishal Patel



________________________________
From: jay harkhani <[hidden email]>
Sent: Wednesday, May 20, 2020 7:39 PM
To: [hidden email] <[hidden email]>
Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

Hello,

Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.

Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).

Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view

Logs and Thread dump stack trace
Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view

To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?

Can someone please help to isolate this issue.

Regards,
Jay Harkhani.
Reply | Threaded
Open this post in threaded view
|

Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

Jörn Franke
Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing? Was it based on the latest template?
If not then please try this. Maybe also you need to increase the corresponding caches in the config.

What happens if you reexecute the query?

Are there other processes/containers running on the same VM?

How much heap and how much total memory you have? You should only have a minor fraction of the memory as heap and most of it „free“ (this means it is used for file caches).



> Am 21.05.2020 um 15:24 schrieb vishal patel <[hidden email]>:
>
> Any one is looking this issue?
> I got same issue.
>
> Regards,
> Vishal Patel
>
>
>
> ________________________________
> From: jay harkhani <[hidden email]>
> Sent: Wednesday, May 20, 2020 7:39 PM
> To: [hidden email] <[hidden email]>
> Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Hello,
>
> Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.
>
> Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).
>
> Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
>
> Logs and Thread dump stack trace
> Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
>
> To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?
>
> Can someone please help to isolate this issue.
>
> Regards,
> Jay Harkhani.
Reply | Threaded
Open this post in threaded view
|

Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

jay harkhani
Hello,

Please refer below details.

>Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing?
Yes, We have created collection from scratch and also re-indexing.

>Was it based on the latest template?
Yes, It was as per latest template.

>What happens if you reexecute the query?
Not more visible difference. Minor change in milliseconds.

>Are there other processes/containers running on the same VM?
No

>How much heap and how much total memory you have?
My heap and total memory are same as Solr 6.1.0. heap memory 5 gb and total memory 25gb. As per me there is no issue related to memory.

>Maybe also you need to increase the corresponding caches in the config.
We are not using cache in both version.

Both version have same configuration.

Regards,
Jay Harkhani.

________________________________
From: Jörn Franke <[hidden email]>
Sent: Thursday, May 21, 2020 7:05 PM
To: [hidden email] <[hidden email]>
Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing? Was it based on the latest template?
If not then please try this. Maybe also you need to increase the corresponding caches in the config.

What happens if you reexecute the query?

Are there other processes/containers running on the same VM?

How much heap and how much total memory you have? You should only have a minor fraction of the memory as heap and most of it „free“ (this means it is used for file caches).



> Am 21.05.2020 um 15:24 schrieb vishal patel <[hidden email]>:
>
> Any one is looking this issue?
> I got same issue.
>
> Regards,
> Vishal Patel
>
>
>
> ________________________________
> From: jay harkhani <[hidden email]>
> Sent: Wednesday, May 20, 2020 7:39 PM
> To: [hidden email] <[hidden email]>
> Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Hello,
>
> Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.
>
> Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).
>
> Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
>
> Logs and Thread dump stack trace
> Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
>
> To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?
>
> Can someone please help to isolate this issue.
>
> Regards,
> Jay Harkhani.
Reply | Threaded
Open this post in threaded view
|

Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

Jason Gerlowski
Hi Jay,

I can't speak to why you're seeing a performance change between 6.x
and 8.x.  What I can suggest though is an alternative way of
formulating the query: you might get different performance if you run
your query using Solr's "terms" query parser:
https://lucene.apache.org/solr/guide/8_5/other-parsers.html#terms-query-parser
 It's not guaranteed to help, but there's a chance it'll work for you.
And knowing whether or not it helps might point others here towards
the cause of your slowdown.

Even if "terms" performs better for you, it's probably worth
understanding what's going on here of course.

Are all other queries running comparably?

Jason

On Thu, May 21, 2020 at 10:25 AM jay harkhani <[hidden email]> wrote:

>
> Hello,
>
> Please refer below details.
>
> >Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing?
> Yes, We have created collection from scratch and also re-indexing.
>
> >Was it based on the latest template?
> Yes, It was as per latest template.
>
> >What happens if you reexecute the query?
> Not more visible difference. Minor change in milliseconds.
>
> >Are there other processes/containers running on the same VM?
> No
>
> >How much heap and how much total memory you have?
> My heap and total memory are same as Solr 6.1.0. heap memory 5 gb and total memory 25gb. As per me there is no issue related to memory.
>
> >Maybe also you need to increase the corresponding caches in the config.
> We are not using cache in both version.
>
> Both version have same configuration.
>
> Regards,
> Jay Harkhani.
>
> ________________________________
> From: Jörn Franke <[hidden email]>
> Sent: Thursday, May 21, 2020 7:05 PM
> To: [hidden email] <[hidden email]>
> Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing? Was it based on the latest template?
> If not then please try this. Maybe also you need to increase the corresponding caches in the config.
>
> What happens if you reexecute the query?
>
> Are there other processes/containers running on the same VM?
>
> How much heap and how much total memory you have? You should only have a minor fraction of the memory as heap and most of it „free“ (this means it is used for file caches).
>
>
>
> > Am 21.05.2020 um 15:24 schrieb vishal patel <[hidden email]>:
> >
> > Any one is looking this issue?
> > I got same issue.
> >
> > Regards,
> > Vishal Patel
> >
> >
> >
> > ________________________________
> > From: jay harkhani <[hidden email]>
> > Sent: Wednesday, May 20, 2020 7:39 PM
> > To: [hidden email] <[hidden email]>
> > Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> >
> > Hello,
> >
> > Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.
> >
> > Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).
> >
> > Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
> >
> > Logs and Thread dump stack trace
> > Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> > Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
> >
> > To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?
> >
> > Can someone please help to isolate this issue.
> >
> > Regards,
> > Jay Harkhani.
Reply | Threaded
Open this post in threaded view
|

Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

vishal patel-2
Hi Jason

Thanks for reply.

I have checked jay's query using "terms" query parser and it is really helpful to us. After execute using "terms" query parser it will come within a 500 milliseconds even though grouping is applied.
Jay's Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view

Actually I want to apply same things in my query but my field "msg_id" is applied boost.group is also used in my query.
I am also upgrading Solr 8.5.1.


MY query is : https://drive.google.com/file/d/1Op_Ja292Bcnv0Ijxw6VdAxvGlfsdczmS/view

I got 30 seconds for above query. How can I use the "terms" query parser in my query?

Regards,
Vishal Patel
________________________________
From: Jason Gerlowski <[hidden email]>
Sent: Friday, May 22, 2020 2:59 AM
To: [hidden email] <[hidden email]>
Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

Hi Jay,

I can't speak to why you're seeing a performance change between 6.x
and 8.x.  What I can suggest though is an alternative way of
formulating the query: you might get different performance if you run
your query using Solr's "terms" query parser:
https://lucene.apache.org/solr/guide/8_5/other-parsers.html#terms-query-parser
 It's not guaranteed to help, but there's a chance it'll work for you.
And knowing whether or not it helps might point others here towards
the cause of your slowdown.

Even if "terms" performs better for you, it's probably worth
understanding what's going on here of course.

Are all other queries running comparably?

Jason

On Thu, May 21, 2020 at 10:25 AM jay harkhani <[hidden email]> wrote:

>
> Hello,
>
> Please refer below details.
>
> >Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing?
> Yes, We have created collection from scratch and also re-indexing.
>
> >Was it based on the latest template?
> Yes, It was as per latest template.
>
> >What happens if you reexecute the query?
> Not more visible difference. Minor change in milliseconds.
>
> >Are there other processes/containers running on the same VM?
> No
>
> >How much heap and how much total memory you have?
> My heap and total memory are same as Solr 6.1.0. heap memory 5 gb and total memory 25gb. As per me there is no issue related to memory.
>
> >Maybe also you need to increase the corresponding caches in the config.
> We are not using cache in both version.
>
> Both version have same configuration.
>
> Regards,
> Jay Harkhani.
>
> ________________________________
> From: Jörn Franke <[hidden email]>
> Sent: Thursday, May 21, 2020 7:05 PM
> To: [hidden email] <[hidden email]>
> Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing? Was it based on the latest template?
> If not then please try this. Maybe also you need to increase the corresponding caches in the config.
>
> What happens if you reexecute the query?
>
> Are there other processes/containers running on the same VM?
>
> How much heap and how much total memory you have? You should only have a minor fraction of the memory as heap and most of it „free“ (this means it is used for file caches).
>
>
>
> > Am 21.05.2020 um 15:24 schrieb vishal patel <[hidden email]>:
> >
> > Any one is looking this issue?
> > I got same issue.
> >
> > Regards,
> > Vishal Patel
> >
> >
> >
> > ________________________________
> > From: jay harkhani <[hidden email]>
> > Sent: Wednesday, May 20, 2020 7:39 PM
> > To: [hidden email] <[hidden email]>
> > Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> >
> > Hello,
> >
> > Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.
> >
> > Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).
> >
> > Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
> >
> > Logs and Thread dump stack trace
> > Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> > Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
> >
> > To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?
> >
> > Can someone please help to isolate this issue.
> >
> > Regards,
> > Jay Harkhani.
Reply | Threaded
Open this post in threaded view
|

Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

Mikhail Khludnev-2
Unfortunately {!terms} doesn't let one ^boost terms.

On Sat, May 23, 2020 at 10:13 AM vishal patel <[hidden email]>
wrote:

> Hi Jason
>
> Thanks for reply.
>
> I have checked jay's query using "terms" query parser and it is really
> helpful to us. After execute using "terms" query parser it will come within
> a 500 milliseconds even though grouping is applied.
> Jay's Query :
> https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
>
> Actually I want to apply same things in my query but my field "msg_id" is
> applied boost.group is also used in my query.
> I am also upgrading Solr 8.5.1.
>
>
> MY query is :
> https://drive.google.com/file/d/1Op_Ja292Bcnv0Ijxw6VdAxvGlfsdczmS/view
>
> I got 30 seconds for above query. How can I use the "terms" query parser
> in my query?
>
> Regards,
> Vishal Patel
> ________________________________
> From: Jason Gerlowski <[hidden email]>
> Sent: Friday, May 22, 2020 2:59 AM
> To: [hidden email] <[hidden email]>
> Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Hi Jay,
>
> I can't speak to why you're seeing a performance change between 6.x
> and 8.x.  What I can suggest though is an alternative way of
> formulating the query: you might get different performance if you run
> your query using Solr's "terms" query parser:
>
> https://lucene.apache.org/solr/guide/8_5/other-parsers.html#terms-query-parser
>  It's not guaranteed to help, but there's a chance it'll work for you.
> And knowing whether or not it helps might point others here towards
> the cause of your slowdown.
>
> Even if "terms" performs better for you, it's probably worth
> understanding what's going on here of course.
>
> Are all other queries running comparably?
>
> Jason
>
> On Thu, May 21, 2020 at 10:25 AM jay harkhani <[hidden email]>
> wrote:
> >
> > Hello,
> >
> > Please refer below details.
> >
> > >Did you create Solrconfig.xml for the collection from scratch after
> upgrading and reindexing?
> > Yes, We have created collection from scratch and also re-indexing.
> >
> > >Was it based on the latest template?
> > Yes, It was as per latest template.
> >
> > >What happens if you reexecute the query?
> > Not more visible difference. Minor change in milliseconds.
> >
> > >Are there other processes/containers running on the same VM?
> > No
> >
> > >How much heap and how much total memory you have?
> > My heap and total memory are same as Solr 6.1.0. heap memory 5 gb and
> total memory 25gb. As per me there is no issue related to memory.
> >
> > >Maybe also you need to increase the corresponding caches in the config.
> > We are not using cache in both version.
> >
> > Both version have same configuration.
> >
> > Regards,
> > Jay Harkhani.
> >
> > ________________________________
> > From: Jörn Franke <[hidden email]>
> > Sent: Thursday, May 21, 2020 7:05 PM
> > To: [hidden email] <[hidden email]>
> > Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> >
> > Did you create Solrconfig.xml for the collection from scratch after
> upgrading and reindexing? Was it based on the latest template?
> > If not then please try this. Maybe also you need to increase the
> corresponding caches in the config.
> >
> > What happens if you reexecute the query?
> >
> > Are there other processes/containers running on the same VM?
> >
> > How much heap and how much total memory you have? You should only have a
> minor fraction of the memory as heap and most of it „free“ (this means it
> is used for file caches).
> >
> >
> >
> > > Am 21.05.2020 um 15:24 schrieb vishal patel <
> [hidden email]>:
> > >
> > > Any one is looking this issue?
> > > I got same issue.
> > >
> > > Regards,
> > > Vishal Patel
> > >
> > >
> > >
> > > ________________________________
> > > From: jay harkhani <[hidden email]>
> > > Sent: Wednesday, May 20, 2020 7:39 PM
> > > To: [hidden email] <[hidden email]>
> > > Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> > >
> > > Hello,
> > >
> > > Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across
> one issue. Query which have more ids (around 3000) and grouping is applied
> takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1
> it takes 26090ms. While take reading we have same solr schema and same no.
> of records in both solr version.
> > >
> > > Please refer below details for query, logs and thead dump (generate
> from Solr Admin while execute query).
> > >
> > > Query :
> https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
> > >
> > > Logs and Thread dump stack trace
> > > Solr 8.5.1 :
> https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> > > Solr 6.1.0 :
> https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
> > >
> > > To analyse further more we found that if we remove grouping field or
> we reduce no. of ids from query it execute fast. Is anything change in
> 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along
> with grouping it works faster?
> > >
> > > Can someone please help to isolate this issue.
> > >
> > > Regards,
> > > Jay Harkhani.
>


--
Sincerely yours
Mikhail Khludnev
Reply | Threaded
Open this post in threaded view
|

Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

vishal patel-2
Is there any other option?

Sent from Outlook<http://aka.ms/weboutlook>
________________________________
From: Mikhail Khludnev <[hidden email]>
Sent: Sunday, May 24, 2020 3:24 AM
To: solr-user <[hidden email]>
Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

Unfortunately {!terms} doesn't let one ^boost terms.

On Sat, May 23, 2020 at 10:13 AM vishal patel <[hidden email]>
wrote:

> Hi Jason
>
> Thanks for reply.
>
> I have checked jay's query using "terms" query parser and it is really
> helpful to us. After execute using "terms" query parser it will come within
> a 500 milliseconds even though grouping is applied.
> Jay's Query :
> https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
>
> Actually I want to apply same things in my query but my field "msg_id" is
> applied boost.group is also used in my query.
> I am also upgrading Solr 8.5.1.
>
>
> MY query is :
> https://drive.google.com/file/d/1Op_Ja292Bcnv0Ijxw6VdAxvGlfsdczmS/view
>
> I got 30 seconds for above query. How can I use the "terms" query parser
> in my query?
>
> Regards,
> Vishal Patel
> ________________________________
> From: Jason Gerlowski <[hidden email]>
> Sent: Friday, May 22, 2020 2:59 AM
> To: [hidden email] <[hidden email]>
> Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Hi Jay,
>
> I can't speak to why you're seeing a performance change between 6.x
> and 8.x.  What I can suggest though is an alternative way of
> formulating the query: you might get different performance if you run
> your query using Solr's "terms" query parser:
>
> https://lucene.apache.org/solr/guide/8_5/other-parsers.html#terms-query-parser
>  It's not guaranteed to help, but there's a chance it'll work for you.
> And knowing whether or not it helps might point others here towards
> the cause of your slowdown.
>
> Even if "terms" performs better for you, it's probably worth
> understanding what's going on here of course.
>
> Are all other queries running comparably?
>
> Jason
>
> On Thu, May 21, 2020 at 10:25 AM jay harkhani <[hidden email]>
> wrote:
> >
> > Hello,
> >
> > Please refer below details.
> >
> > >Did you create Solrconfig.xml for the collection from scratch after
> upgrading and reindexing?
> > Yes, We have created collection from scratch and also re-indexing.
> >
> > >Was it based on the latest template?
> > Yes, It was as per latest template.
> >
> > >What happens if you reexecute the query?
> > Not more visible difference. Minor change in milliseconds.
> >
> > >Are there other processes/containers running on the same VM?
> > No
> >
> > >How much heap and how much total memory you have?
> > My heap and total memory are same as Solr 6.1.0. heap memory 5 gb and
> total memory 25gb. As per me there is no issue related to memory.
> >
> > >Maybe also you need to increase the corresponding caches in the config.
> > We are not using cache in both version.
> >
> > Both version have same configuration.
> >
> > Regards,
> > Jay Harkhani.
> >
> > ________________________________
> > From: Jörn Franke <[hidden email]>
> > Sent: Thursday, May 21, 2020 7:05 PM
> > To: [hidden email] <[hidden email]>
> > Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> >
> > Did you create Solrconfig.xml for the collection from scratch after
> upgrading and reindexing? Was it based on the latest template?
> > If not then please try this. Maybe also you need to increase the
> corresponding caches in the config.
> >
> > What happens if you reexecute the query?
> >
> > Are there other processes/containers running on the same VM?
> >
> > How much heap and how much total memory you have? You should only have a
> minor fraction of the memory as heap and most of it „free“ (this means it
> is used for file caches).
> >
> >
> >
> > > Am 21.05.2020 um 15:24 schrieb vishal patel <
> [hidden email]>:
> > >
> > > Any one is looking this issue?
> > > I got same issue.
> > >
> > > Regards,
> > > Vishal Patel
> > >
> > >
> > >
> > > ________________________________
> > > From: jay harkhani <[hidden email]>
> > > Sent: Wednesday, May 20, 2020 7:39 PM
> > > To: [hidden email] <[hidden email]>
> > > Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> > >
> > > Hello,
> > >
> > > Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across
> one issue. Query which have more ids (around 3000) and grouping is applied
> takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1
> it takes 26090ms. While take reading we have same solr schema and same no.
> of records in both solr version.
> > >
> > > Please refer below details for query, logs and thead dump (generate
> from Solr Admin while execute query).
> > >
> > > Query :
> https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
> > >
> > > Logs and Thread dump stack trace
> > > Solr 8.5.1 :
> https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> > > Solr 6.1.0 :
> https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
> > >
> > > To analyse further more we found that if we remove grouping field or
> we reduce no. of ids from query it execute fast. Is anything change in
> 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along
> with grouping it works faster?
> > >
> > > Can someone please help to isolate this issue.
> > >
> > > Regards,
> > > Jay Harkhani.
>


--
Sincerely yours
Mikhail Khludnev