solr instance keep increasing thread count

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

solr instance keep increasing thread count

andy
we use solrcloud with version 5.2.1,openjdk 1.8,we have multiple solr
machines, one of them keep increasing thread count ,I saw from
<a href="http://xxxxxx:xxx/solr/#/~threads">http://xxxxxx:xxx/solr/#/~threads page, I found that a lot of
[java.util.concurrent.locks.ReentrantReadWriteLock$FairSync@xxxxx] threads,
the detail info like this:

sun.misc.Unsafe.park​(Native Method)
java.util.concurrent.locks.LockSupport.park​(LockSupport.java:175)
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt​(AbstractQueuedSynchronizer.java:836)
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared​(AbstractQueuedSynchronizer.java:967)
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared​(AbstractQueuedSynchronizer.java:1283)
java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock​(ReentrantReadWriteLock.java:727)
org.apache.solr.update.VersionInfo.lockForUpdate​(VersionInfo.java:110)
org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit​(DistributedUpdateProcessor.java:1630)
org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit​(DistributedUpdateProcessor.java:1612)
org.apache.solr.update.processor.LogUpdateProcessor.processCommit​(LogUpdateProcessorFactory.java:161)
org.apache.solr.handler.RequestHandlerUtils.handleCommit​(RequestHandlerUtils.java:69)
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody​(ContentStreamHandlerBase.java:68)
org.apache.solr.handler.RequestHandlerBase.handleRequest​(RequestHandlerBase.java:143)
org.apache.solr.core.SolrCore.execute​(SolrCore.java:2064)
org.apache.solr.servlet.HttpSolrCall.execute​(HttpSolrCall.java:654)
org.apache.solr.servlet.HttpSolrCall.call​(HttpSolrCall.java:450)
org.apache.solr.servlet.SolrDispatchFilter.doFilter​(SolrDispatchFilter.java:227)
org.apache.solr.servlet.SolrDispatchFilter.doFilter​(SolrDispatchFilter.java:196)
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter​(ServletHandler.java:1652)
org.eclipse.jetty.servlet.ServletHandler.doHandle​(ServletHandler.java:585)
org.eclipse.jetty.server.handler.ScopedHandler.handle​(ScopedHandler.java:143)
org.eclipse.jetty.security.SecurityHandler.handle​(SecurityHandler.java:577)
org.eclipse.jetty.server.session.SessionHandler.doHandle​(SessionHandler.java:223)
org.eclipse.jetty.server.handler.ContextHandler.doHandle​(ContextHandler.java:1127)
org.eclipse.jetty.servlet.ServletHandler.doScope​(ServletHandler.java:515)
org.eclipse.jetty.server.session.SessionHandler.doScope​(SessionHandler.java:185)
org.eclipse.jetty.server.handler.ContextHandler.doScope​(ContextHandler.java:1061)
org.eclipse.jetty.server.handler.ScopedHandler.handle​(ScopedHandler.java:141)
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle​(ContextHandlerCollection.java:215)
org.eclipse.jetty.server.handler.HandlerCollection.handle​(HandlerCollection.java:110)
org.eclipse.jetty.server.handler.HandlerWrapper.handle​(HandlerWrapper.java:97)
org.eclipse.jetty.server.Server.handle​(Server.java:497)
org.eclipse.jetty.server.HttpChannel.handle​(HttpChannel.java:310)
org.eclipse.jetty.server.HttpConnection.onFillable​(HttpConnection.java:257)
org.eclipse.jetty.io.AbstractConnection$2.run​(AbstractConnection.java:540)
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob​(QueuedThreadPool.java:635)
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run​(QueuedThreadPool.java:555)
java.lang.Thread.run​(Thread.java:745)


anyone know the  probably reson for this?




--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
Reply | Threaded
Open this post in threaded view
|

Re: solr instance keep increasing thread count

Mikhail Khludnev-2
I bet it's caused by unreasonable rate of commits. Stop streaming commits
so much.

On Tue, Dec 4, 2018 at 11:08 AM andy <[hidden email]> wrote:

> we use solrcloud with version 5.2.1,openjdk 1.8,we have multiple solr
> machines, one of them keep increasing thread count ,I saw from
> <a href="http://xxxxxx:xxx/solr/#/~threads">http://xxxxxx:xxx/solr/#/~threads page, I found that a lot of
> [java.util.concurrent.locks.ReentrantReadWriteLock$FairSync@xxxxx]
> threads,
> the detail info like this:
>
> sun.misc.Unsafe.park​(Native Method)
> java.util.concurrent.locks.LockSupport.park​(LockSupport.java:175)
>
> java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt​(AbstractQueuedSynchronizer.java:836)
>
> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared​(AbstractQueuedSynchronizer.java:967)
>
> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared​(AbstractQueuedSynchronizer.java:1283)
>
> java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock​(ReentrantReadWriteLock.java:727)
> org.apache.solr.update.VersionInfo.lockForUpdate​(VersionInfo.java:110)
>
> org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit​(DistributedUpdateProcessor.java:1630)
>
> org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit​(DistributedUpdateProcessor.java:1612)
>
> org.apache.solr.update.processor.LogUpdateProcessor.processCommit​(LogUpdateProcessorFactory.java:161)
>
> org.apache.solr.handler.RequestHandlerUtils.handleCommit​(RequestHandlerUtils.java:69)
>
> org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody​(ContentStreamHandlerBase.java:68)
>
> org.apache.solr.handler.RequestHandlerBase.handleRequest​(RequestHandlerBase.java:143)
> org.apache.solr.core.SolrCore.execute​(SolrCore.java:2064)
> org.apache.solr.servlet.HttpSolrCall.execute​(HttpSolrCall.java:654)
> org.apache.solr.servlet.HttpSolrCall.call​(HttpSolrCall.java:450)
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter​(SolrDispatchFilter.java:227)
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter​(SolrDispatchFilter.java:196)
>
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter​(ServletHandler.java:1652)
> org.eclipse.jetty.servlet.ServletHandler.doHandle​(ServletHandler.java:585)
>
> org.eclipse.jetty.server.handler.ScopedHandler.handle​(ScopedHandler.java:143)
>
> org.eclipse.jetty.security.SecurityHandler.handle​(SecurityHandler.java:577)
>
> org.eclipse.jetty.server.session.SessionHandler.doHandle​(SessionHandler.java:223)
>
> org.eclipse.jetty.server.handler.ContextHandler.doHandle​(ContextHandler.java:1127)
> org.eclipse.jetty.servlet.ServletHandler.doScope​(ServletHandler.java:515)
>
> org.eclipse.jetty.server.session.SessionHandler.doScope​(SessionHandler.java:185)
>
> org.eclipse.jetty.server.handler.ContextHandler.doScope​(ContextHandler.java:1061)
>
> org.eclipse.jetty.server.handler.ScopedHandler.handle​(ScopedHandler.java:141)
>
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle​(ContextHandlerCollection.java:215)
>
> org.eclipse.jetty.server.handler.HandlerCollection.handle​(HandlerCollection.java:110)
>
> org.eclipse.jetty.server.handler.HandlerWrapper.handle​(HandlerWrapper.java:97)
> org.eclipse.jetty.server.Server.handle​(Server.java:497)
> org.eclipse.jetty.server.HttpChannel.handle​(HttpChannel.java:310)
>
> org.eclipse.jetty.server.HttpConnection.onFillable​(HttpConnection.java:257)
> org.eclipse.jetty.io
> .AbstractConnection$2.run​(AbstractConnection.java:540)
>
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob​(QueuedThreadPool.java:635)
>
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run​(QueuedThreadPool.java:555)
> java.lang.Thread.run​(Thread.java:745)
>
>
> anyone know the  probably reson for this?
>
>
>
>
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
>


--
Sincerely yours
Mikhail Khludnev
Reply | Threaded
Open this post in threaded view
|

Re: solr instance keep increasing thread count

andy
update about 3000 docs per minute ,but other solr instance is running
normally



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html