Solr 5.3.1: Collection reload results in IndexWriter is closed exception

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Solr 5.3.1: Collection reload results in IndexWriter is closed exception

Kelly, Frank
Just wondering if anyone has seen this before and might understand why this is happening

Environment:
Solr 5.3.1 in Solr Cloud (3 shards each with 3 replicas across 3 EC2 Vms)
100m documents (20+ GB index) 

Previously we’ve done reloads of a collection after changing solrconfig.xml without any issues.
This time we saw it across 3 of 3 environments where we got several Solr’s showing “IndexWriter is closed” errors and had to stop and restart those Solr instances.
In our final environment we skipped the RELOAD and just did solr stop, solr start.

The solrconfig.xml change we made was turning on the replication handler (not sure if this has any bearing on the issue)

<requestHandler name="/replication" class="solr.ReplicationHandler">
    <lst name="defaults">
      <str name="maxWriteMBPerSec">96</str>
      <str name="httpConnTimeout">60000</str>
      <str name="httpReadTimeout">60000</str>
   </lst>
 </requestHandler>

Is there anything “unsafe” about reload on a collection that is handling live traffic in that version?

Cheers!

-Frank

 

Frank Kelly

Principal Software Engineer

 

HERE 

5 Wayside Rd, Burlington, MA 01803, USA

42° 29' 7" N 71° 11' 32" W

 

               
Reply | Threaded
Open this post in threaded view
|

Re: Solr 5.3.1: Collection reload results in IndexWriter is closed exception

Fuad Efendi
Were you indexing new documents while reloading? “Previously we’ve done
reloads of a collection after changing solrconfig.xml without any issues.”

--

Fuad Efendi

(416) 993-2060

http://www.tokenizer.ca
Search Relevancy, Recommender Systems


From: Kelly, Frank <[hidden email]> <[hidden email]>
Reply: [hidden email] <[hidden email]>
<[hidden email]>
Date: February 7, 2017 at 12:19:21 PM
To: [hidden email] <[hidden email]>
<[hidden email]>
Subject:  Solr 5.3.1: Collection reload results in IndexWriter is closed
exception

Just wondering if anyone has seen this before and might understand why this
is happening

Environment:
Solr 5.3.1 in Solr Cloud (3 shards each with 3 replicas across 3 EC2 Vms)
100m documents (20+ GB index)

Previously we’ve done reloads of a collection after changing solrconfig.xml
without any issues.
This time we saw it across 3 of 3 environments where we got several Solr’s
showing “IndexWriter is closed” errors and had to stop and restart those
Solr instances.
In our final environment we skipped the RELOAD and just did solr stop, solr
start.

The solrconfig.xml change we made was turning on the replication handler
(not sure if this has any bearing on the issue)

<requestHandler name="/replication" class="solr.ReplicationHandler">
    <lst name="defaults">
      <str name="maxWriteMBPerSec">96</str>
      <str name="httpConnTimeout">60000</str>
      <str name="httpReadTimeout">60000</str>
   </lst>
 </requestHandler>

Is there anything “unsafe” about reload on a collection that is handling
live traffic in that version?

Cheers!

-Frank

[image: Description: Macintosh
HD:Users:jerchow:Downloads:Asset_Package_01_160721:HERE_Logo_2016:sRGB:PDF:HERE_Logo_2016_POS_sRGB.pdf]



*Frank Kelly*

*Principal Software Engineer*



HERE

5 Wayside Rd, Burlington, MA 01803, USA

*42° 29' 7" N 71° 11' 32" W*


[image: Description:
/Users/nussbaum/_WORK/PROJECTS/20160726_HERE_EMail_Signature/_Layout/_Images/20160726_HERE_EMail_Signature_360.gif]
<http://360.here.com/>    [image: Description:
/Users/nussbaum/_WORK/PROJECTS/20160726_HERE_EMail_Signature/_Layout/_Images/20160726_HERE_EMail_Signature_Twitter.gif]
<https://www.twitter.com/here>   [image: Description:
/Users/nussbaum/_WORK/PROJECTS/20160726_HERE_EMail_Signature/_Layout/_Images/20160726_HERE_EMail_Signature_FB.gif]
<https://www.facebook.com/here>    [image: Description:
/Users/nussbaum/_WORK/PROJECTS/20160726_HERE_EMail_Signature/_Layout/_Images/20160726_HERE_EMail_Signature_IN.gif]
<https://www.linkedin.com/company/heremaps>    [image: Description:
/Users/nussbaum/_WORK/PROJECTS/20160726_HERE_EMail_Signature/_Layout/_Images/20160726_HERE_EMail_Signature_Insta.gif]
<https://www.instagram.com/here/>