Backup a solr cloud collection - timeout in 180s?

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Backup a solr cloud collection - timeout in 180s?

Petersen, Robert (Contr)
Shouldn't this just create the backup file(s) asynchronously? Can the timeout be adjusted?


Solr 7.2.1 with five nodes and the addrsearch collection is five shards x five replicas and "numFound":38837970 docs


Thx

Robi


http://myServer.corp.pvt:8983/solr/admin/collections?action=BACKUP&name=addrsearchBackup&collection=addrsearch&location=/apps/logs/backups


  *
     *
responseHeader:
{
        *
status: 500,
        *
QTime: 180211
},
     *
error:
{
        *
metadata:
[
           *
"error-class",
           *
"org.apache.solr.common.SolrException",
           *
"root-error-class",
           *
"org.apache.solr.common.SolrException"
],
        *
msg: "backup the collection time out:180s",
  *


From the logs:


2018-04-09 17:47:32.667 INFO  (qtp64830413-22) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=addrsearchBackup&action=BACKUP&location=/apps/logs/backups&collection=addrsearch} status=500 QTime=180211
2018-04-09 17:47:32.667 ERROR (qtp64830413-22) [   ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: backup the collection time out:180s
        at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:314)
        at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:246)
        at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:224)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
        at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
        at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
        at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)



________________________________

This communication is confidential. Frontier only sends and receives email on the basis of the terms set out at http://www.frontier.com/email_disclaimer.
Reply | Threaded
Open this post in threaded view
|

Re: Backup a solr cloud collection - timeout in 180s?

Erick Erickson
Specify the "async" property, see:
https://lucene.apache.org/solr/guide/6_6/collections-api.html

There's also a way to check the status of the backup running in the background.

Best,
Erick

On Mon, Apr 9, 2018 at 11:05 AM, Petersen, Robert (Contr)
<[hidden email]> wrote:

> Shouldn't this just create the backup file(s) asynchronously? Can the timeout be adjusted?
>
>
> Solr 7.2.1 with five nodes and the addrsearch collection is five shards x five replicas and "numFound":38837970 docs
>
>
> Thx
>
> Robi
>
>
> http://myServer.corp.pvt:8983/solr/admin/collections?action=BACKUP&name=addrsearchBackup&collection=addrsearch&location=/apps/logs/backups
>
>
>   *
>      *
> responseHeader:
> {
>         *
> status: 500,
>         *
> QTime: 180211
> },
>      *
> error:
> {
>         *
> metadata:
> [
>            *
> "error-class",
>            *
> "org.apache.solr.common.SolrException",
>            *
> "root-error-class",
>            *
> "org.apache.solr.common.SolrException"
> ],
>         *
> msg: "backup the collection time out:180s",
>   *
>
>
> From the logs:
>
>
> 2018-04-09 17:47:32.667 INFO  (qtp64830413-22) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=addrsearchBackup&action=BACKUP&location=/apps/logs/backups&collection=addrsearch} status=500 QTime=180211
> 2018-04-09 17:47:32.667 ERROR (qtp64830413-22) [   ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: backup the collection time out:180s
>         at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:314)
>         at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:246)
>         at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:224)
>         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
>         at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
>         at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
>         at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
>
>
>
> ________________________________
>
> This communication is confidential. Frontier only sends and receives email on the basis of the terms set out at http://www.frontier.com/email_disclaimer.
Reply | Threaded
Open this post in threaded view
|

Re: Backup a solr cloud collection - timeout in 180s?

Petersen, Robert (Contr)
HI Erick,


I *just* found that parameter in the guide... it was waaay down at the bottom of the page (in proverbial small print)!


So for other readers the steps are this:

# start the backup async enabled

/admin/collections?action=BACKUP&name=addrsearchBackup&collection=addrsearch&location=/apps/logs/backups&async=1234


# check on the status of the async job

/admin/collections?action=REQUESTSTATUS&requestid=1234


# clear out the status when done

/admin/collections?action=DELETESTATUS&requestid=1234


Thx

Robi

________________________________
From: Erick Erickson <[hidden email]>
Sent: Tuesday, April 10, 2018 8:24:20 AM
To: solr-user
Subject: Re: Backup a solr cloud collection - timeout in 180s?

________________________________
WARNING: External email. Please verify sender before opening attachments or clicking on links.
________________________________



Specify the "async" property, see:
https://lucene.apache.org/solr/guide/6_6/collections-api.html

There's also a way to check the status of the backup running in the background.

Best,
Erick

On Mon, Apr 9, 2018 at 11:05 AM, Petersen, Robert (Contr)
<[hidden email]> wrote:

> Shouldn't this just create the backup file(s) asynchronously? Can the timeout be adjusted?
>
>
> Solr 7.2.1 with five nodes and the addrsearch collection is five shards x five replicas and "numFound":38837970 docs
>
>
> Thx
>
> Robi
>
>
> http://myServer.corp.pvt:8983/solr/admin/collections?action=BACKUP&name=addrsearchBackup&collection=addrsearch&location=/apps/logs/backups
>
>
>   *
>      *
> responseHeader:
> {
>         *
> status: 500,
>         *
> QTime: 180211
> },
>      *
> error:
> {
>         *
> metadata:
> [
>            *
> "error-class",
>            *
> "org.apache.solr.common.SolrException",
>            *
> "root-error-class",
>            *
> "org.apache.solr.common.SolrException"
> ],
>         *
> msg: "backup the collection time out:180s",
>   *
>
>
> From the logs:
>
>
> 2018-04-09 17:47:32.667 INFO  (qtp64830413-22) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=addrsearchBackup&action=BACKUP&location=/apps/logs/backups&collection=addrsearch} status=500 QTime=180211
> 2018-04-09 17:47:32.667 ERROR (qtp64830413-22) [   ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: backup the collection time out:180s
>         at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:314)
>         at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:246)
>         at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:224)
>         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
>         at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
>         at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
>         at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
>
>
>
> ________________________________
>
> This communication is confidential. Frontier only sends and receives email on the basis of the terms set out at http://www.frontier.com/email_disclaimer.
Reply | Threaded
Open this post in threaded view
|

Re: Backup a solr cloud collection - timeout in 180s?

Erick Erickson
Robi:

Yeah, the ref guide has lots and lots and lots of info, but at 1,100
pages and growing things can be "interesting" to find.

Do be aware of one thing. The async ID should be unique and before 7.3
there was a bug that if you used the same ID twice (without waiting
for completion and deleting it first) it lead to bewildering results.
See: https://issues.apache.org/jira/browse/SOLR-11739.

The operations would succeed, but you might not be getting the status
of the task you think you are.


Best,
Erick

On Tue, Apr 10, 2018 at 9:25 AM, Petersen, Robert (Contr)
<[hidden email]> wrote:

> HI Erick,
>
>
> I *just* found that parameter in the guide... it was waaay down at the bottom of the page (in proverbial small print)!
>
>
> So for other readers the steps are this:
>
> # start the backup async enabled
>
> /admin/collections?action=BACKUP&name=addrsearchBackup&collection=addrsearch&location=/apps/logs/backups&async=1234
>
>
> # check on the status of the async job
>
> /admin/collections?action=REQUESTSTATUS&requestid=1234
>
>
> # clear out the status when done
>
> /admin/collections?action=DELETESTATUS&requestid=1234
>
>
> Thx
>
> Robi
>
> ________________________________
> From: Erick Erickson <[hidden email]>
> Sent: Tuesday, April 10, 2018 8:24:20 AM
> To: solr-user
> Subject: Re: Backup a solr cloud collection - timeout in 180s?
>
> ________________________________
> WARNING: External email. Please verify sender before opening attachments or clicking on links.
> ________________________________
>
>
>
> Specify the "async" property, see:
> https://lucene.apache.org/solr/guide/6_6/collections-api.html
>
> There's also a way to check the status of the backup running in the background.
>
> Best,
> Erick
>
> On Mon, Apr 9, 2018 at 11:05 AM, Petersen, Robert (Contr)
> <[hidden email]> wrote:
>> Shouldn't this just create the backup file(s) asynchronously? Can the timeout be adjusted?
>>
>>
>> Solr 7.2.1 with five nodes and the addrsearch collection is five shards x five replicas and "numFound":38837970 docs
>>
>>
>> Thx
>>
>> Robi
>>
>>
>> http://myServer.corp.pvt:8983/solr/admin/collections?action=BACKUP&name=addrsearchBackup&collection=addrsearch&location=/apps/logs/backups
>>
>>
>>   *
>>      *
>> responseHeader:
>> {
>>         *
>> status: 500,
>>         *
>> QTime: 180211
>> },
>>      *
>> error:
>> {
>>         *
>> metadata:
>> [
>>            *
>> "error-class",
>>            *
>> "org.apache.solr.common.SolrException",
>>            *
>> "root-error-class",
>>            *
>> "org.apache.solr.common.SolrException"
>> ],
>>         *
>> msg: "backup the collection time out:180s",
>>   *
>>
>>
>> From the logs:
>>
>>
>> 2018-04-09 17:47:32.667 INFO  (qtp64830413-22) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=addrsearchBackup&action=BACKUP&location=/apps/logs/backups&collection=addrsearch} status=500 QTime=180211
>> 2018-04-09 17:47:32.667 ERROR (qtp64830413-22) [   ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: backup the collection time out:180s
>>         at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:314)
>>         at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:246)
>>         at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:224)
>>         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
>>         at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
>>         at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
>>         at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
>>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
>>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
>>
>>
>>
>> ________________________________
>>
>> This communication is confidential. Frontier only sends and receives email on the basis of the terms set out at http://www.frontier.com/email_disclaimer.
Reply | Threaded
Open this post in threaded view
|

RE: Backup a solr cloud collection - timeout in 180s?

Petersen, Robert (Contr)
Erick:

Good to know!

Thx
Robi


-----Original Message-----
From: Erick Erickson <[hidden email]>
Sent: Tuesday, April 10, 2018 12:42 PM
To: solr-user <[hidden email]>
Subject: Re: Backup a solr cloud collection - timeout in 180s?

Robi:

Yeah, the ref guide has lots and lots and lots of info, but at 1,100 pages and growing things can be "interesting" to find.

Do be aware of one thing. The async ID should be unique and before 7.3 there was a bug that if you used the same ID twice (without waiting for completion and deleting it first) it lead to bewildering results.
See: https://issues.apache.org/jira/browse/SOLR-11739.

The operations would succeed, but you might not be getting the status of the task you think you are.


Best,
Erick

On Tue, Apr 10, 2018 at 9:25 AM, Petersen, Robert (Contr) <[hidden email]> wrote:

> HI Erick,
>
>
> I *just* found that parameter in the guide... it was waaay down at the bottom of the page (in proverbial small print)!
>
>
> So for other readers the steps are this:
>
> # start the backup async enabled
>
> /admin/collections?action=BACKUP&name=addrsearchBackup&collection=addr
> search&location=/apps/logs/backups&async=1234
>
>
> # check on the status of the async job
>
> /admin/collections?action=REQUESTSTATUS&requestid=1234
>
>
> # clear out the status when done
>
> /admin/collections?action=DELETESTATUS&requestid=1234
>
>
> Thx
>
> Robi
>
> ________________________________
> From: Erick Erickson <[hidden email]>
> Sent: Tuesday, April 10, 2018 8:24:20 AM
> To: solr-user
> Subject: Re: Backup a solr cloud collection - timeout in 180s?
>
> ________________________________
> WARNING: External email. Please verify sender before opening attachments or clicking on links.
> ________________________________
>
>
>
> Specify the "async" property, see:
> https://lucene.apache.org/solr/guide/6_6/collections-api.html
>
> There's also a way to check the status of the backup running in the background.
>
> Best,
> Erick
>
> On Mon, Apr 9, 2018 at 11:05 AM, Petersen, Robert (Contr)
> <[hidden email]> wrote:
>> Shouldn't this just create the backup file(s) asynchronously? Can the timeout be adjusted?
>>
>>
>> Solr 7.2.1 with five nodes and the addrsearch collection is five
>> shards x five replicas and "numFound":38837970 docs
>>
>>
>> Thx
>>
>> Robi
>>
>>
>> http://myServer.corp.pvt:8983/solr/admin/collections?action=BACKUP&na
>> me=addrsearchBackup&collection=addrsearch&location=/apps/logs/backups
>>
>>
>>   *
>>      *
>> responseHeader:
>> {
>>         *
>> status: 500,
>>         *
>> QTime: 180211
>> },
>>      *
>> error:
>> {
>>         *
>> metadata:
>> [
>>            *
>> "error-class",
>>            *
>> "org.apache.solr.common.SolrException",
>>            *
>> "root-error-class",
>>            *
>> "org.apache.solr.common.SolrException"
>> ],
>>         *
>> msg: "backup the collection time out:180s",
>>   *
>>
>>
>> From the logs:
>>
>>
>> 2018-04-09 17:47:32.667 INFO  (qtp64830413-22) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=addrsearchBackup&action=BACKUP&location=/apps/logs/backups&collection=addrsearch} status=500 QTime=180211
>> 2018-04-09 17:47:32.667 ERROR (qtp64830413-22) [   ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: backup the collection time out:180s
>>         at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:314)
>>         at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:246)
>>         at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:224)
>>         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
>>         at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
>>         at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
>>         at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
>>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
>>         at
>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilte
>> r.java:326)
>>
>>
>>
>> ________________________________
>>
>> This communication is confidential. Frontier only sends and receives email on the basis of the terms set out at http://www.frontier.com/email_disclaimer.