Need information on EofExceptions in solr 4.8.1

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Need information on EofExceptions in solr 4.8.1

Vijay Rawlani
Dear Concerned,

We are using solr 4.8.1 in our project. We are observing following
EofExceptions in solr.
It would be helpful for us to know in what situations we might land up
with this.
Can we get rid of this with any solr configuration or is there any way
forward at all?
Kindly let us know some information about the exception and the scenario
where it can occur.

019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@
org.apache.solr.servlet.SolrDispatchFilter:120 -
null:org.eclipse.jetty.io.EofException#012#011at
org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at
org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at
org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at
org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at
org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at
org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at
org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:431)#012...

2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)#012#011at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)#012#011at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)#012#011at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)#012#011at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)#012#011at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)#012#011at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)#012#011at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)#012#011at
org.eclipse.jetty.server.session.SessionHandler.doScope(Sess...

2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@193)#012#011at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)#012#011at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)#012#011at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)#012#011at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)#012#011at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)#012#011at
org.eclipse.jetty.server.Server.handle(Server.java:368)#012#011at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)#012#011at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)#012#011at
org.e...

2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@953)#012#011at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)#012#011at
org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)#012#011at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)#012#011at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)#012#011at
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)#012#011at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)#012#011at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)#012#011at
java.lang.Thread.run(Thread.java:748)#012

2019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@
org.eclipse.jetty.server.Response:312 - Committed before 500
{trace=org.eclipse.jetty.io.EofException#012#011at
org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at
org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at
org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at
org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at
org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at
org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at
org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja...


Thanks in advance.

Best Regards,
Vijay Rawlani
Tata Consultancy Services Ltd.
+91 7416448048
=====-----=====-----=====
Notice: The information contained in this e-mail
message and/or attachments to it may contain
confidential or privileged information. If you are
not the intended recipient, any dissemination, use,
review, distribution, printing or copying of the
information contained in this e-mail message
and/or attachments to it are strictly prohibited. If
you have received this communication in error,
please notify us by reply e-mail or telephone and
immediately and permanently delete the message
and any attachments. Thank you


Reply | Threaded
Open this post in threaded view
|

Re: Need information on EofExceptions in solr 4.8.1

Saurabh Sharma
Hi,

Seems like it is not a problem with solr. It is happening due to stream
termination at the jetty.
Please make sure your client is not setting very low read timeout. You can
also increase max sessions timeout and idleTimeout at jetty level.

Thanks
Saurabh Sharma

On Tue, Mar 19, 2019 at 11:19 PM Vijay Rawlani <[hidden email]>
wrote:

> Dear Concerned,
>
> We are using solr 4.8.1 in our project. We are observing following
> EofExceptions in solr.
> It would be helpful for us to know in what situations we might land up
> with this.
> Can we get rid of this with any solr configuration or is there any way
> forward at all?
> Kindly let us know some information about the exception and the scenario
> where it can occur.
>
> 019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@
> org.apache.solr.servlet.SolrDispatchFilter:120 -
> null:org.eclipse.jetty.io.EofException#012#011at
> org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at
> org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at
> org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at
>
> org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at
>
> org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at
>
> org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at
>
> org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at
>
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:431)#012...
>
> 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)#012#011at
>
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)#012#011at
>
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)#012#011at
>
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)#012#011at
>
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)#012#011at
>
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)#012#011at
>
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)#012#011at
>
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)#012#011at
>
> org.eclipse.jetty.server.session.SessionHandler.doScope(Sess...
>
> 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@193)#012#011at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)#012#011at
>
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)#012#011at
>
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)#012#011at
>
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)#012#011at
>
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)#012#011at
>
> org.eclipse.jetty.server.Server.handle(Server.java:368)#012#011at
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)#012#011at
>
> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)#012#011at
>
> org.e...
>
> 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@953)#012#011at
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)#012#011at
>
> org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)#012#011at
> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)#012#011at
>
> org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)#012#011at
>
> org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)#012#011at
>
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)#012#011at
>
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)#012#011at
>
> java.lang.Thread.run(Thread.java:748)#012
>
> 2019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@
> org.eclipse.jetty.server.Response:312 - Committed before 500
> {trace=org.eclipse.jetty.io.EofException#012#011at
> org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at
> org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at
> org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at
>
> org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at
>
> org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at
>
> org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at
>
> org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at
>
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja...
>
>
> Thanks in advance.
>
> Best Regards,
> Vijay Rawlani
> Tata Consultancy Services Ltd.
> +91 7416448048
> =====-----=====-----=====
> Notice: The information contained in this e-mail
> message and/or attachments to it may contain
> confidential or privileged information. If you are
> not the intended recipient, any dissemination, use,
> review, distribution, printing or copying of the
> information contained in this e-mail message
> and/or attachments to it are strictly prohibited. If
> you have received this communication in error,
> please notify us by reply e-mail or telephone and
> immediately and permanently delete the message
> and any attachments. Thank you
>
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Need information on EofExceptions in solr 4.8.1

Atita Arora
Precisely, socketTimeout ms if it's your indexing pipeline code.
We faced this when our docs were unusually bigger.

On Tue, Mar 19, 2019 at 7:08 PM Saurabh Sharma <[hidden email]>
wrote:

> Hi,
>
> Seems like it is not a problem with solr. It is happening due to stream
> termination at the jetty.
> Please make sure your client is not setting very low read timeout. You can
> also increase max sessions timeout and idleTimeout at jetty level.
>
> Thanks
> Saurabh Sharma
>
> On Tue, Mar 19, 2019 at 11:19 PM Vijay Rawlani <[hidden email]>
> wrote:
>
> > Dear Concerned,
> >
> > We are using solr 4.8.1 in our project. We are observing following
> > EofExceptions in solr.
> > It would be helpful for us to know in what situations we might land up
> > with this.
> > Can we get rid of this with any solr configuration or is there any way
> > forward at all?
> > Kindly let us know some information about the exception and the scenario
> > where it can occur.
> >
> > 019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@
> > org.apache.solr.servlet.SolrDispatchFilter:120 -
> > null:org.eclipse.jetty.io.EofException#012#011at
> > org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at
> > org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at
> >
> org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at
> >
> >
> org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at
> >
> >
> org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at
> >
> >
> org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at
> >
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:431)#012...
> >
> > 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)#012#011at
> >
> >
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)#012#011at
> >
> >
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)#012#011at
> >
> >
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)#012#011at
> >
> >
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)#012#011at
> >
> >
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)#012#011at
> >
> > org.eclipse.jetty.server.session.SessionHandler.doScope(Sess...
> >
> > 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@193)#012#011at
> >
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)#012#011at
> >
> > org.eclipse.jetty.server.Server.handle(Server.java:368)#012#011at
> >
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)#012#011at
> >
> >
> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)#012#011at
> >
> > org.e...
> >
> > 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@953)#012#011at
> >
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)#012#011at
> >
> >
> org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)#012#011at
> >
> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)#012#011at
> >
> >
> org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)#012#011at
> >
> >
> org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)#012#011at
> >
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)#012#011at
> >
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)#012#011at
> >
> > java.lang.Thread.run(Thread.java:748)#012
> >
> > 2019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@
> > org.eclipse.jetty.server.Response:312 - Committed before 500
> > {trace=org.eclipse.jetty.io.EofException#012#011at
> > org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at
> > org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at
> >
> org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at
> >
> >
> org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at
> >
> >
> org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at
> >
> >
> org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at
> >
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja...
> >
> >
> > Thanks in advance.
> >
> > Best Regards,
> > Vijay Rawlani
> > Tata Consultancy Services Ltd.
> > +91 7416448048
> > =====-----=====-----=====
> > Notice: The information contained in this e-mail
> > message and/or attachments to it may contain
> > confidential or privileged information. If you are
> > not the intended recipient, any dissemination, use,
> > review, distribution, printing or copying of the
> > information contained in this e-mail message
> > and/or attachments to it are strictly prohibited. If
> > you have received this communication in error,
> > please notify us by reply e-mail or telephone and
> > immediately and permanently delete the message
> > and any attachments. Thank you
> >
> >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Need information on EofExceptions in solr 4.8.1

Shawn Heisey-2
In reply to this post by Vijay Rawlani
On 3/19/2019 10:39 AM, Vijay Rawlani wrote:
> We are using solr 4.8.1 in our project. We are observing following
> EofExceptions in solr.
> It would be helpful for us to know in what situations we might land up
> with this.
> Can we get rid of this with any solr configuration or is there any way
> forward at all?
> Kindly let us know some information about the exception and the scenario
> where it can occur.

When Solr throws Jetty's EofException, it almost always means this has
occurred:

The client talking to Solr has disconnected its TCP connection before
Solr has finished processing the request.  When Solr (Jetty) finally
finishes and tries to send the response, the client is long gone and the
response cannot be sent.  So EofException is thrown.

Usually this is because the client has a short timeout and the requests
Solr is being asked to process are taking longer than that timeout to
complete.  If a client is configured with a timeout, it should be quite
long ... normally at least a minute, and two to five minutes would be
better.

Solr 4.8.1 is nearly four years old.  This is ancient in the open source
world.  There will be no bugfixes for a version that old.  I do not
think the behavior you are seeing is a bug, but if you do encounter one,
you'll need to reproduce it in an 8.x version before we can fix it.

Thanks,
Shawn