Overseer session expires on multiple collection creation

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Overseer session expires on multiple collection creation

apoorvqwerty
Hi,
I am trying to create multiple collections with 2 shards and 2 replications each.
After 5-6 successful
overseer status response for 5 creations shows 40k requests for collection_operations=>am_i_leader which is a bit odd.
and I get
Am I not supposed to create 8-10 collections one after the other or is there some configuration that I'm missing.
On creation of 8th collection I get following overseer session expired exception
<nabble_embed> nExpiredException: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-0000000024 at org.apache.zookeeper.KeeperException.create(KeeperException.java:127) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045) at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:322) at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:319) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:319) at org.apache.solr.cloud.OverseerTaskQueue.remove(OverseerTaskQueue.java:93) at org.apache.solr.cloud.OverseerTaskProcessor$Runner.markTaskComplete(OverseerTaskProcessor.java:525) at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:483) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) </nabble_embed>

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Overseer session expires on multiple collection creation

Markus Jelsma-2
Hi - any ideas on this one?

Many thanks,
Markus
 
-----Original message-----

> From:apoorvqwerty <[hidden email]>
> Sent: Friday 21st April 2017 15:04
> To: [hidden email]
> Subject: Overseer session expires on multiple collection creation
>
> Hi,
> I am trying to create multiple collections with 2 shards and 2 replications
> each.
> After 5-6 successful
> overseer status response for 5 creations shows 40k requests for
> collection_operations=>am_i_leader which is a bit odd.
> and I get
> Am I not supposed to create 8-10 collections one after the other or is there
> some configuration that I'm missing.
> On creation of 8th collection I get following overseer session expired
> exception
>
> nExpiredException: KeeperErrorCode = Session expired for
> /overseer/collection-queue-work/qnr-0000000024
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
> at
> org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:322)
> at
> org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:319)
> at
> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:319)
> at
> org.apache.solr.cloud.OverseerTaskQueue.remove(OverseerTaskQueue.java:93)
> at
> org.apache.solr.cloud.OverseerTaskProcessor$Runner.markTaskComplete(OverseerTaskProcessor.java:525)
> at
> org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:483)
> at
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Overseer-session-expires-on-multiple-collection-creation-tp4331265.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Overseer session expires on multiple collection creation

apoorvqwerty
So i figured out the issue i was facing
https://issues.apache.org/jira/browse/SOLR-9803

<updateHandler class="solr.DirectUpdateHandler2">
    <updateLog>
      <str name="dir">${solr.ulog.dir:}</str>
      <int name="numVersionBuckets">${solr.ulog.numVersionBuckets:8388608}</int>
    </updateLog>


i had a huge value set fir numVersioinBuckets which was causing memory leak as stated in issue 9803

Changing to default value solved my problem
Loading...