Timeout Settings

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Timeout Settings

DANIEL CLARK-4
I'm indexing about 10,000,000 docs and I'm getting the following error at
the optimize stage.  I'm using Tomcat 6.  I believe it's timing out due to
the size of the index.  How can increase the timeout setting while it's
optimizing?  Any help would be greatly appreciated.

 

java.lang.Exception:

        at org.apache.solr.client.SolrClient.update(SolrClient.java:660)

        at org.apache.solr.client.SolrClient.update(SolrClient.java:620)

        at
org.apache.solr.client.SolrClient.addDocuments(SolrClient.java:580)

        at
org.apache.solr.client.SolrClient.addDocuments(SolrClient.java:595)

        at
com.aol.music.search.indexer2.MusicIndexer$SolrUpdateTask.call(MusicIndexer.
java:244)

        at
com.aol.music.search.indexer2.MusicIndexer$SolrUpdateTask.call(MusicIndexer.
java:214)

        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269)

        at java.util.concurrent.FutureTask.run(FutureTask.java:123)

        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.ja
va:650)

        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
75)

        at java.lang.Thread.run(Thread.java:595)

Caused by: java.net.SocketTimeoutException: Read timed out

        at java.net.SocketInputStream.socketRead0(Native Method)

        at java.net.SocketInputStream.read(SocketInputStream.java:129)

        at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)

        at java.io.BufferedInputStream.read(BufferedInputStream.java:235)

        at
org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:77)

        at
org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:105)

        at
org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:11
15)

        at
org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnect
ionAdapter.readLine(MultiThreadedHttpConnectionManager.java:1373)

        at
org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.j
ava:1832)

        at
org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.jav
a:1590)

        at
org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:995
)

        at
org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethod
Director.java:397)

        at
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDir
ector.java:170)

        at
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396)

        at
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:324)

        at org.apache.solr.client.SolrClient.update(SolrClient.java:637)

        ... 10 more

 

~~~~~~~~~~~~~~~~~~~~~

Daniel Clark, President

DAC Systems, Inc.

(703) 403-0340

~~~~~~~~~~~~~~~~~~~~~

 

Reply | Threaded
Open this post in threaded view
|

RE: Timeout Settings

Charlie Jackson
The CommonsHttpSolrServer has a setConnectionTimeout method. For my
import, which was on a similar scale as yours, I had to set it up to
1000 (1 second). I think messing with this setting may take care of your
timeout problem.



-----Original Message-----
From: Daniel Clark [mailto:[hidden email]]
Sent: Monday, October 22, 2007 6:59 PM
To: [hidden email]
Subject: Timeout Settings

I'm indexing about 10,000,000 docs and I'm getting the following error
at
the optimize stage.  I'm using Tomcat 6.  I believe it's timing out due
to
the size of the index.  How can increase the timeout setting while it's
optimizing?  Any help would be greatly appreciated.

 

java.lang.Exception:

        at org.apache.solr.client.SolrClient.update(SolrClient.java:660)

        at org.apache.solr.client.SolrClient.update(SolrClient.java:620)

        at
org.apache.solr.client.SolrClient.addDocuments(SolrClient.java:580)

        at
org.apache.solr.client.SolrClient.addDocuments(SolrClient.java:595)

        at
com.aol.music.search.indexer2.MusicIndexer$SolrUpdateTask.call(MusicInde
xer.
java:244)

        at
com.aol.music.search.indexer2.MusicIndexer$SolrUpdateTask.call(MusicInde
xer.
java:214)

        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269)

        at java.util.concurrent.FutureTask.run(FutureTask.java:123)

        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecuto
r.ja
va:650)

        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.ja
va:6
75)

        at java.lang.Thread.run(Thread.java:595)

Caused by: java.net.SocketTimeoutException: Read timed out

        at java.net.SocketInputStream.socketRead0(Native Method)

        at java.net.SocketInputStream.read(SocketInputStream.java:129)

        at
java.io.BufferedInputStream.fill(BufferedInputStream.java:218)

        at
java.io.BufferedInputStream.read(BufferedInputStream.java:235)

        at
org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:77)

        at
org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:105)

        at
org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.jav
a:11
15)

        at
org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpCon
nect
ionAdapter.readLine(MultiThreadedHttpConnectionManager.java:1373)

        at
org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBa
se.j
ava:1832)

        at
org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase
.jav
a:1590)

        at
org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java
:995
)

        at
org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMe
thod
Director.java:397)

        at
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMetho
dDir
ector.java:170)

        at
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:3
96)

        at
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:3
24)

        at org.apache.solr.client.SolrClient.update(SolrClient.java:637)

        ... 10 more

 

~~~~~~~~~~~~~~~~~~~~~

Daniel Clark, President

DAC Systems, Inc.

(703) 403-0340

~~~~~~~~~~~~~~~~~~~~~