[jira] [Created] (SOLR-2661) Snppul failed - Unable to download index

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (SOLR-2661) Snppul failed - Unable to download index

Nick Burch (Jira)
Snppul failed - Unable to download index
----------------------------------------

                 Key: SOLR-2661
                 URL: https://issues.apache.org/jira/browse/SOLR-2661
             Project: Solr
          Issue Type: Bug
          Components: replication (java)
    Affects Versions: 1.4.1
         Environment: Linux
            Reporter: Jayesh K Rajpurohit
            Priority: Critical


Getting this exception in my application. Now we are blocked as slaves are not able to download any new indexes. FYI. The optimized index size is 5.5 GB and it goes to 11 GB (non-optimized index size). There are some questions which I have regarding this:
1) Is there any size limit of index to replicate ? Because in exception we can get it is trying to download the index of 0.4 GB.
2) Is there any connection timeout setting with solr Java replication ?


2011-07-18 07:22:18,634 [pool-3-thread-1] ERROR org.apache.solr.handler.ReplicationHandler  - SnapPull failed
org.apache.solr.common.SolrException: Unable to download _nr.frq completely. Downloaded 57671680!=404386786
        at org.apache.solr.handler.SnapPuller$FileFetcher.cleanup(SnapPuller.java:1026)
        at org.apache.solr.handler.SnapPuller$FileFetcher.fetchFile(SnapPuller.java:906)
        at org.apache.solr.handler.SnapPuller.downloadIndexFiles(SnapPuller.java:541)
        at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:294)
        at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:264)
        at org.apache.solr.handler.SnapPuller$1.run(SnapPuller.java:159)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)


Regards,
Jayesh K Rajpurohit


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (SOLR-2661) SnapPull failed - Unable to download index

Nick Burch (Jira)

     [ https://issues.apache.org/jira/browse/SOLR-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jayesh K Rajpurohit updated SOLR-2661:
--------------------------------------

    Summary: SnapPull failed - Unable to download index  (was: Snappul failed - Unable to download index)

> SnapPull failed - Unable to download index
> ------------------------------------------
>
>                 Key: SOLR-2661
>                 URL: https://issues.apache.org/jira/browse/SOLR-2661
>             Project: Solr
>          Issue Type: Bug
>          Components: replication (java)
>    Affects Versions: 1.4.1
>         Environment: Linux
>            Reporter: Jayesh K Rajpurohit
>            Priority: Critical
>
> Getting this exception in my application. Now we are blocked as slaves are not able to download any new indexes. FYI. The optimized index size is 5.5 GB and it goes to 11 GB (non-optimized index size). There are some questions which I have regarding this:
> 1) Is there any size limit of index to replicate ? Because in exception we can get it is trying to download the index of 0.4 GB.
> 2) Is there any connection timeout setting with solr Java replication ?
> 2011-07-18 07:22:18,634 [pool-3-thread-1] ERROR org.apache.solr.handler.ReplicationHandler  - SnapPull failed
> org.apache.solr.common.SolrException: Unable to download _nr.frq completely. Downloaded 57671680!=404386786
>         at org.apache.solr.handler.SnapPuller$FileFetcher.cleanup(SnapPuller.java:1026)
>         at org.apache.solr.handler.SnapPuller$FileFetcher.fetchFile(SnapPuller.java:906)
>         at org.apache.solr.handler.SnapPuller.downloadIndexFiles(SnapPuller.java:541)
>         at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:294)
>         at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:264)
>         at org.apache.solr.handler.SnapPuller$1.run(SnapPuller.java:159)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>         at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
>         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:662)
> Regards,
> Jayesh K Rajpurohit

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (SOLR-2661) Snappul failed - Unable to download index

Nick Burch (Jira)
In reply to this post by Nick Burch (Jira)

     [ https://issues.apache.org/jira/browse/SOLR-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jayesh K Rajpurohit updated SOLR-2661:
--------------------------------------

    Summary: Snappul failed - Unable to download index  (was: Snppul failed - Unable to download index)

> Snappul failed - Unable to download index
> -----------------------------------------
>
>                 Key: SOLR-2661
>                 URL: https://issues.apache.org/jira/browse/SOLR-2661
>             Project: Solr
>          Issue Type: Bug
>          Components: replication (java)
>    Affects Versions: 1.4.1
>         Environment: Linux
>            Reporter: Jayesh K Rajpurohit
>            Priority: Critical
>
> Getting this exception in my application. Now we are blocked as slaves are not able to download any new indexes. FYI. The optimized index size is 5.5 GB and it goes to 11 GB (non-optimized index size). There are some questions which I have regarding this:
> 1) Is there any size limit of index to replicate ? Because in exception we can get it is trying to download the index of 0.4 GB.
> 2) Is there any connection timeout setting with solr Java replication ?
> 2011-07-18 07:22:18,634 [pool-3-thread-1] ERROR org.apache.solr.handler.ReplicationHandler  - SnapPull failed
> org.apache.solr.common.SolrException: Unable to download _nr.frq completely. Downloaded 57671680!=404386786
>         at org.apache.solr.handler.SnapPuller$FileFetcher.cleanup(SnapPuller.java:1026)
>         at org.apache.solr.handler.SnapPuller$FileFetcher.fetchFile(SnapPuller.java:906)
>         at org.apache.solr.handler.SnapPuller.downloadIndexFiles(SnapPuller.java:541)
>         at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:294)
>         at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:264)
>         at org.apache.solr.handler.SnapPuller$1.run(SnapPuller.java:159)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>         at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
>         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:662)
> Regards,
> Jayesh K Rajpurohit

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (SOLR-2661) SnapPull failed - Unable to download index

Nick Burch (Jira)
In reply to this post by Nick Burch (Jira)

    [ https://issues.apache.org/jira/browse/SOLR-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13066913#comment-13066913 ]

Martijn van Groningen commented on SOLR-2661:
---------------------------------------------

bq. 1) Is there any size limit of index to replicate? Because in exception we can get it is trying to download the index of 0.4 GB.
Not that I know of. How often do you replicate your index? If you replicate often you might want to increase the commitReserveDuration option on the master. For configuration see: http://wiki.apache.org/solr/SolrReplication#Master
bq. 2) Is there any connection timeout setting with solr Java replication ?
Yes there is a setting for this. See wiki:
http://wiki.apache.org/solr/SolrReplication#Slave 

> SnapPull failed - Unable to download index
> ------------------------------------------
>
>                 Key: SOLR-2661
>                 URL: https://issues.apache.org/jira/browse/SOLR-2661
>             Project: Solr
>          Issue Type: Bug
>          Components: replication (java)
>    Affects Versions: 1.4.1
>         Environment: Linux
>            Reporter: Jayesh K Rajpurohit
>            Priority: Critical
>
> Getting this exception in my application. Now we are blocked as slaves are not able to download any new indexes. FYI. The optimized index size is 5.5 GB and it goes to 11 GB (non-optimized index size). There are some questions which I have regarding this:
> 1) Is there any size limit of index to replicate ? Because in exception we can get it is trying to download the index of 0.4 GB.
> 2) Is there any connection timeout setting with solr Java replication ?
> 2011-07-18 07:22:18,634 [pool-3-thread-1] ERROR org.apache.solr.handler.ReplicationHandler  - SnapPull failed
> org.apache.solr.common.SolrException: Unable to download _nr.frq completely. Downloaded 57671680!=404386786
>         at org.apache.solr.handler.SnapPuller$FileFetcher.cleanup(SnapPuller.java:1026)
>         at org.apache.solr.handler.SnapPuller$FileFetcher.fetchFile(SnapPuller.java:906)
>         at org.apache.solr.handler.SnapPuller.downloadIndexFiles(SnapPuller.java:541)
>         at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:294)
>         at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:264)
>         at org.apache.solr.handler.SnapPuller$1.run(SnapPuller.java:159)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>         at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
>         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:662)
> Regards,
> Jayesh K Rajpurohit

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]