snapinstaller does not start newSearcher

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

snapinstaller does not start newSearcher

alxsss
Hello,

I am using latest solr (solr trunk) . I run snapinstaller, and see that it copies snapshot to index folder but changes are not picked up and

 logs in slave after running snapinstaller are

44302 [qtp1312571113-14] INFO  org.apache.solr.update.UpdateHandler  – start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
44303 [qtp1312571113-14] INFO  org.apache.solr.update.UpdateHandler  – No uncommitted changes. Skipping IW.commit.
44304 [qtp1312571113-14] INFO  org.apache.solr.core.SolrCore  – SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
44305 [qtp1312571113-14] INFO  org.apache.solr.update.UpdateHandler  – end_commit_flush
44305 [qtp1312571113-14] INFO  org.apache.solr.update.processor.LogUpdateProcessor  – [product] webapp=/solr path=/update params={} {commit=} 0 57

Restarting solr  gives

 Error creating core [product]: Error opening new searcher
org.apache.solr.common.SolrException: Error opening new searcher
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
        at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1565)
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1677)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:845)
        ... 9 more

Any idea what causes this issue.

Thanks in advance.
Alex.

Reply | Threaded
Open this post in threaded view
|

Re: snapinstaller does not start newSearcher

Shalin Shekhar Mangar
Do you mean the snapinstaller (bash) script? Those are legacy scripts. It's
been a long time since they were tested. The ReplicationHandler is the
recommended way to setup replication. If you want to take a snapshot then
the replication handler has an HTTP based API which lets you do that.

In any case, do you have the full stack trace for that exception? There
should be another cause nested under it.

On Tue, Feb 24, 2015 at 12:47 PM, <[hidden email]> wrote:

> Hello,
>
> I am using latest solr (solr trunk) . I run snapinstaller, and see that it
> copies snapshot to index folder but changes are not picked up and
>
>  logs in slave after running snapinstaller are
>
> 44302 [qtp1312571113-14] INFO  org.apache.solr.update.UpdateHandler  –
> start
> commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
> 44303 [qtp1312571113-14] INFO  org.apache.solr.update.UpdateHandler  – No
> uncommitted changes. Skipping IW.commit.
> 44304 [qtp1312571113-14] INFO  org.apache.solr.core.SolrCore  –
> SolrIndexSearcher has not changed - not re-opening:
> org.apache.solr.search.SolrIndexSearcher
> 44305 [qtp1312571113-14] INFO  org.apache.solr.update.UpdateHandler  –
> end_commit_flush
> 44305 [qtp1312571113-14] INFO
> org.apache.solr.update.processor.LogUpdateProcessor  – [product]
> webapp=/solr path=/update params={} {commit=} 0 57
>
> Restarting solr  gives
>
>  Error creating core [product]: Error opening new searcher
> org.apache.solr.common.SolrException: Error opening new searcher
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
>         at
> org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
>         at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
>         at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
>         at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:724)
> Caused by: org.apache.solr.common.SolrException: Error opening new searcher
>         at
> org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1565)
>         at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1677)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:845)
>         ... 9 more
>
> Any idea what causes this issue.
>
> Thanks in advance.
> Alex.
>
>


--
Regards,
Shalin Shekhar Mangar.
Reply | Threaded
Open this post in threaded view
|

Re: snapinstaller does not start newSearcher

alxsss
Hello,

We cannot use replication with the current architecture, so decided to use snapshotter with snapinstaller.

Here is the full stack trace

8937 [coreLoadExecutor-5-thread-3] INFO  org.apache.solr.core.CachingDirectoryFactory  – Closing directory: /home/solr/solr-4.10.1/solr/example/solr/product/data
8938 [coreLoadExecutor-5-thread-3] ERROR org.apache.solr.core.CoreContainer  – Error creating core [product]: Error opening new searcher
org.apache.solr.common.SolrException: Error opening new searcher
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
        at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1565)
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1677)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:845)
        ... 9 more
Caused by: java.nio.file.NoSuchFileException: /home/solr/solr-4.10.1/solr/example/solr/product/data/index/segments_4
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:176)
        at java.nio.channels.FileChannel.open(FileChannel.java:287)
        at java.nio.channels.FileChannel.open(FileChannel.java:334)
        at org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:196)
        at org.apache.lucene.store.NRTCachingDirectory.openInput(NRTCachingDirectory.java:198)
        at org.apache.lucene.store.Directory.openChecksumInput(Directory.java:113)
        at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:341)
        at org.apache.lucene.index.SegmentInfos$1.doBody(SegmentInfos.java:454)
        at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:906)
        at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:752)
        at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:450)
        at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:792)
        at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:77)
        at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:64)
        at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:279)
        at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:111)
        at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1528)
        ... 11 more
8943 [main] INFO  org.apache.solr.servlet.SolrDispatchFilter  – user.dir=/home/solr/solr-4.10.1/solr/example
8943 [main] INFO  org.apache.solr.servlet.SolrDispatchFilter  – SolrDispatchFilter.init() done
8982 [main] INFO  org.eclipse.jetty.server.AbstractConnector  – Started SocketConnector@0.0.0.0:8983

Thanks.
Alex.

 

 

 

-----Original Message-----
From: Shalin Shekhar Mangar <[hidden email]>
To: solr-user <[hidden email]>
Sent: Tue, Feb 24, 2015 12:13 am
Subject: Re: snapinstaller does not start newSearcher


Do you mean the snapinstaller (bash) script? Those are legacy scripts.
It's
been a long time since they were tested. The ReplicationHandler is
the
recommended way to setup replication. If you want to take a snapshot
then
the replication handler has an HTTP based API which lets you do
that.

In any case, do you have the full stack trace for that exception?
There
should be another cause nested under it.

On Tue, Feb 24, 2015 at 12:47
PM, <[hidden email]> wrote:

> Hello,
>
> I am using latest solr (solr
trunk) . I run snapinstaller, and see that it
> copies snapshot to index folder
but changes are not picked up and
>
>  logs in slave after running
snapinstaller are
>
> 44302 [qtp1312571113-14] INFO
org.apache.solr.update.UpdateHandler  –
> start
>
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
>
44303 [qtp1312571113-14] INFO  org.apache.solr.update.UpdateHandler  – No
>
uncommitted changes. Skipping IW.commit.
> 44304 [qtp1312571113-14] INFO
org.apache.solr.core.SolrCore  –
> SolrIndexSearcher has not changed - not
re-opening:
> org.apache.solr.search.SolrIndexSearcher
> 44305
[qtp1312571113-14] INFO  org.apache.solr.update.UpdateHandler  –
>
end_commit_flush
> 44305 [qtp1312571113-14] INFO
>
org.apache.solr.update.processor.LogUpdateProcessor  – [product]
> webapp=/solr
path=/update params={} {commit=} 0 57
>
> Restarting solr  gives
>
>  Error
creating core [product]: Error opening new searcher
>
org.apache.solr.common.SolrException: Error opening new searcher
>         at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
>         at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
>         at
>
org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
>        
at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
>      
at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
>      
at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>    
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at
>
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
at
>
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
at java.lang.Thread.run(Thread.java:724)
> Caused by:
org.apache.solr.common.SolrException: Error opening new searcher
>        
at
> org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1565)
>      
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1677)
>         at
org.apache.solr.core.SolrCore.<init>(SolrCore.java:845)
>         ... 9
more
>
> Any idea what causes this issue.
>
> Thanks in advance.
>
Alex.
>
>


--
Regards,
Shalin Shekhar Mangar.

 
Reply | Threaded
Open this post in threaded view
|

Re: snapinstaller does not start newSearcher

alxsss
This post was updated on .
I have used snapshotter api and modified snapinstaller script, so that it successfully grabs the snapshot folder and updates index folder in slave. However, it fails to open newSearcher.
It simple, sends a commit command to slave, but  hasUncommittedChanges function returns false.
That is the reason.

Reloading collection picks up changes.

Is it possible that Solr could return no results for queries that were sent during reloading?

Thanks.
Alex.