MultiCore config less stable than SingleCore?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

MultiCore config less stable than SingleCore?

Jan Simon Winkelmann
Hi,

i have recently moved Solr at one of our customers to a MultiCore environment running 2 indexes. Since then, we seem to be having problems with locks not being removed properly, .lock files keep sticking around in the index directory.
Hence, any updates to the index keep returning 500 errors with the following stack trace:

Error 500 Lock obtain timed out: NativeFSLock@/data/jetty/solr/index1/data/index/lucene-96165c133339c16f26b93de3954f6891-write.lock

org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: NativeFSLock@/data/jetty/solr/index1/data/index/lucene-96165c133339c16f26b93de3954f6891-write.lock
        at org.apache.lucene.store.Lock.obtain(Lock.java:85)
        at org.apache.lucene.index.IndexWriter.init(IndexWriter.java:1545)
        at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:1402)
        at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:190)
        at org.apache.solr.update.UpdateHandler.createMainIndexWriter(UpdateHandler.java:98)
        at org.apache.solr.update.DirectUpdateHandler2.openWriter(DirectUpdateHandler2.java:173)
        at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:220)
        at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61)
        at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:139)
        at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:69)
        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:54)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1316)
        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1187)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:425)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:457)
        at org.eclipse.jetty.server.session.SessionHandler.handle(SessionHandler.java:182)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:933)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:362)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:867)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:245)
        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
        at org.eclipse.jetty.server.Server.handle(Server.java:334)
        at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:559)
        at org.eclipse.jetty.server.HttpConnection$RequestHandler.content(HttpConnection.java:1007)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:747)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:209)
        at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:406)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:462)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
        at java.lang.Thread.run(Thread.java:662)

All our other installations with a similar SingleCore config are running very smoothly.
Does anyone have an idea what the problem is? Could I have missed something when configuring the MultiCore environment?

Regards,
Jan
Reply | Threaded
Open this post in threaded view
|

Re: MultiCore config less stable than SingleCore?

Erick Erickson
Could you tell us what version of Solr you're running?
And what OS you're concerned about?
And what file system you're operating on?
And anything else you can think of that'd help us help you?

Best
Erick

On Tue, Dec 7, 2010 at 4:56 AM, Jan Simon Winkelmann <
[hidden email]> wrote:

> Hi,
>
> i have recently moved Solr at one of our customers to a MultiCore
> environment running 2 indexes. Since then, we seem to be having problems
> with locks not being removed properly, .lock files keep sticking around in
> the index directory.
> Hence, any updates to the index keep returning 500 errors with the
> following stack trace:
>
> Error 500 Lock obtain timed out: NativeFSLock@
> /data/jetty/solr/index1/data/index/lucene-96165c133339c16f26b93de3954f6891-write.lock
>
> org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out:
> NativeFSLock@
> /data/jetty/solr/index1/data/index/lucene-96165c133339c16f26b93de3954f6891-write.lock
>        at org.apache.lucene.store.Lock.obtain(Lock.java:85)
>        at org.apache.lucene.index.IndexWriter.init(IndexWriter.java:1545)
>        at
> org.apache.lucene.index.IndexWriter.&lt;init&gt;(IndexWriter.java:1402)
>        at
> org.apache.solr.update.SolrIndexWriter.&lt;init&gt;(SolrIndexWriter.java:190)
>        at
> org.apache.solr.update.UpdateHandler.createMainIndexWriter(UpdateHandler.java:98)
>        at
> org.apache.solr.update.DirectUpdateHandler2.openWriter(DirectUpdateHandler2.java:173)
>        at
> org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:220)
>        at
> org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61)
>        at
> org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:139)
>        at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:69)
>        at
> org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:54)
>        at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1316)
>        at
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
>        at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241)
>        at
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1187)
>        at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:425)
>        at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>        at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:457)
>        at
> org.eclipse.jetty.server.session.SessionHandler.handle(SessionHandler.java:182)
>        at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:933)
>        at
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:362)
>        at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:867)
>        at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>        at
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:245)
>        at
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
>        at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
>        at org.eclipse.jetty.server.Server.handle(Server.java:334)
>        at
> org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:559)
>        at
> org.eclipse.jetty.server.HttpConnection$RequestHandler.content(HttpConnection.java:1007)
>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:747)
>        at
> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:209)
>        at
> org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:406)
>        at
> org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:462)
>        at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
>        at java.lang.Thread.run(Thread.java:662)
>
> All our other installations with a similar SingleCore config are running
> very smoothly.
> Does anyone have an idea what the problem is? Could I have missed something
> when configuring the MultiCore environment?
>
> Regards,
> Jan
>