NPE when faceting

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

NPE when faceting

Jamie Johnson
I had reported this issue a while back, hoping that it was something
with my environment, but that doesn't seem to be the case.  I am
getting the following stack trace on certain facet queries.
Previously when I did an optimize the error went away, does anyone
have any insight into why specifically this could be happening?

May 1, 2012 8:48:52 PM org.apache.solr.common.SolrException log
SEVERE: java.lang.NullPointerException
        at org.apache.lucene.index.DocTermOrds.lookupTerm(DocTermOrds.java:807)
        at org.apache.solr.request.UnInvertedField.getTermValue(UnInvertedField.java:636)
        at org.apache.solr.request.UnInvertedField.getCounts(UnInvertedField.java:411)
        at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:300)
        at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:396)
        at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:205)
        at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:81)
        at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:204)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1550)
        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
        at org.eclipse.jetty.server.Server.handle(Server.java:351)
        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
        at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
        at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
        at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
        at java.lang.Thread.run(Thread.java:662)
Reply | Threaded
Open this post in threaded view
|

Re: NPE when faceting

Jamie Johnson
it may be related this this

http://stackoverflow.com/questions/10124055/solr-faceted-search-throws-nullpointerexception-with-http-500-status

we are doing deletes from our index as well so it is possible that
we're running into the same issue.  I hope that sheds more light on
things.

On Tue, May 1, 2012 at 4:51 PM, Jamie Johnson <[hidden email]> wrote:

> I had reported this issue a while back, hoping that it was something
> with my environment, but that doesn't seem to be the case.  I am
> getting the following stack trace on certain facet queries.
> Previously when I did an optimize the error went away, does anyone
> have any insight into why specifically this could be happening?
>
> May 1, 2012 8:48:52 PM org.apache.solr.common.SolrException log
> SEVERE: java.lang.NullPointerException
>        at org.apache.lucene.index.DocTermOrds.lookupTerm(DocTermOrds.java:807)
>        at org.apache.solr.request.UnInvertedField.getTermValue(UnInvertedField.java:636)
>        at org.apache.solr.request.UnInvertedField.getCounts(UnInvertedField.java:411)
>        at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:300)
>        at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:396)
>        at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:205)
>        at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:81)
>        at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:204)
>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1550)
>        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
>        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
>        at org.eclipse.jetty.server.Server.handle(Server.java:351)
>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
>        at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>        at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
>        at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
>        at java.lang.Thread.run(Thread.java:662)
Reply | Threaded
Open this post in threaded view
|

Re: NPE when faceting

Yonik Seeley-2-2
In reply to this post by Jamie Johnson
Darn... looks likely that it's another bug from when part of
UnInvertedField was refactored into Lucene.
We really need some random tests that can catch bugs like these though
- I'll see if I can reproduce.

Can you open a JIRA issue for this?

-Yonik
lucenerevolution.com - Lucene/Solr Open Source Search Conference.
Boston May 7-10


On Tue, May 1, 2012 at 4:51 PM, Jamie Johnson <[hidden email]> wrote:

> I had reported this issue a while back, hoping that it was something
> with my environment, but that doesn't seem to be the case.  I am
> getting the following stack trace on certain facet queries.
> Previously when I did an optimize the error went away, does anyone
> have any insight into why specifically this could be happening?
>
> May 1, 2012 8:48:52 PM org.apache.solr.common.SolrException log
> SEVERE: java.lang.NullPointerException
>        at org.apache.lucene.index.DocTermOrds.lookupTerm(DocTermOrds.java:807)
>        at org.apache.solr.request.UnInvertedField.getTermValue(UnInvertedField.java:636)
>        at org.apache.solr.request.UnInvertedField.getCounts(UnInvertedField.java:411)
>        at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:300)
>        at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:396)
>        at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:205)
>        at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:81)
>        at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:204)
>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1550)
>        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
>        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
>        at org.eclipse.jetty.server.Server.handle(Server.java:351)
>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
>        at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>        at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
>        at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
>        at java.lang.Thread.run(Thread.java:662)
Reply | Threaded
Open this post in threaded view
|

Re: NPE when faceting

Jamie Johnson
I don't have any more details than I provided here, but I created a
ticket with this information.  Thanks again

https://issues.apache.org/jira/browse/SOLR-3427

On Tue, May 1, 2012 at 5:20 PM, Yonik Seeley <[hidden email]> wrote:

> Darn... looks likely that it's another bug from when part of
> UnInvertedField was refactored into Lucene.
> We really need some random tests that can catch bugs like these though
> - I'll see if I can reproduce.
>
> Can you open a JIRA issue for this?
>
> -Yonik
> lucenerevolution.com - Lucene/Solr Open Source Search Conference.
> Boston May 7-10
>
>
> On Tue, May 1, 2012 at 4:51 PM, Jamie Johnson <[hidden email]> wrote:
>> I had reported this issue a while back, hoping that it was something
>> with my environment, but that doesn't seem to be the case.  I am
>> getting the following stack trace on certain facet queries.
>> Previously when I did an optimize the error went away, does anyone
>> have any insight into why specifically this could be happening?
>>
>> May 1, 2012 8:48:52 PM org.apache.solr.common.SolrException log
>> SEVERE: java.lang.NullPointerException
>>        at org.apache.lucene.index.DocTermOrds.lookupTerm(DocTermOrds.java:807)
>>        at org.apache.solr.request.UnInvertedField.getTermValue(UnInvertedField.java:636)
>>        at org.apache.solr.request.UnInvertedField.getCounts(UnInvertedField.java:411)
>>        at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:300)
>>        at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:396)
>>        at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:205)
>>        at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:81)
>>        at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:204)
>>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1550)
>>        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442)
>>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263)
>>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
>>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
>>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>>        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
>>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>>        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
>>        at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
>>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
>>        at org.eclipse.jetty.server.Server.handle(Server.java:351)
>>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
>>        at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
>>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
>>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
>>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
>>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
>>        at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
>>        at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
>>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
>>        at java.lang.Thread.run(Thread.java:662)