[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 599 - Failure!

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 599 - Failure!

Policeman Jenkins Server-2
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/599/
Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

All tests passed

Build Log:
[...truncated 34268 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:386: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:325: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:120: The following files are missing svn:eol-style (or binary svn:mime-type):
* solr/webapp/web/css/styles/documents.css
* solr/webapp/web/js/lib/jquery.ajaxfileupload.js
* solr/webapp/web/js/scripts/documents.js
* solr/webapp/web/tpl/documents.html

Total time: 139 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 600 - Still Failing!

Policeman Jenkins Server-2
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/600/
Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.search.TestStressRecovery:     1) Thread[id=10259, name=IPC Parameter Sending Thread #6, state=TIMED_WAITING, group=TGRP-HdfsSyncSliceTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:724)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.search.TestStressRecovery:
   1) Thread[id=10259, name=IPC Parameter Sending Thread #6, state=TIMED_WAITING, group=TGRP-HdfsSyncSliceTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
        at __randomizedtesting.SeedInfo.seed([FB1DF1E4B083C777]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.search.TestStressRecovery

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=10259, name=IPC Parameter Sending Thread #6, state=TIMED_WAITING, group=TGRP-HdfsSyncSliceTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:724)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=10259, name=IPC Parameter Sending Thread #6, state=TIMED_WAITING, group=TGRP-HdfsSyncSliceTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
        at __randomizedtesting.SeedInfo.seed([FB1DF1E4B083C777]:0)




Build Log:
[...truncated 10141 lines...]
[junit4:junit4] Suite: org.apache.solr.search.TestStressRecovery
[junit4:junit4]   2> 3264886 T10239 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-TestStressRecovery-1372305333449
[junit4:junit4]   2> 3264888 T10239 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 3264889 T10239 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3264889 T10239 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 3264986 T10239 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 3265071 T10239 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-tlog.xml
[junit4:junit4]   2> 3265072 T10239 oass.IndexSchema.readSchema Reading Solr Schema from schema15.xml
[junit4:junit4]   2> 3265083 T10239 oass.IndexSchema.readSchema [null] Schema name=test
[junit4:junit4]   2> 3265903 T10239 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3265909 T10239 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3265912 T10239 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3265918 T10239 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3265960 T10239 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3265961 T10239 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 3265961 T10239 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 3265987 T10239 oasc.CoreContainer.<init> New CoreContainer 1818745817
[junit4:junit4]   2> 3266106 T10239 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 3266107 T10239 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-TestStressRecovery-1372305333449/
[junit4:junit4]   2> 3266108 T10239 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f4875cd
[junit4:junit4]   2> 3266109 T10239 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-TestStressRecovery-1372305333449
[junit4:junit4]   2> 3266110 T10239 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-TestStressRecovery-1372305333449/index/
[junit4:junit4]   2> 3266110 T10239 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-TestStressRecovery-1372305333449/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3266111 T10239 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-TestStressRecovery-1372305333449/index
[junit4:junit4]   2> 3266116 T10239 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79ea706e lockFactory=org.apache.lucene.store.NativeFSLockFactory@5603fb5f),segFN=segments_1,generation=1}
[junit4:junit4]   2> 3266117 T10239 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 3266123 T10239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3266126 T10239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3266128 T10239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3266130 T10239 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3266130 T10239 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3266131 T10239 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3266132 T10239 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3266133 T10239 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3266133 T10239 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3266162 T10239 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3266177 T10239 oass.SolrIndexSearcher.<init> Opening Searcher@30266f0b main
[junit4:junit4]   2> 3266178 T10239 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3266179 T10239 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3266183 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@30266f0b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3266186 T10239 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 3266191 T10239 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2> 3266262 T10239 oas.SolrTestCaseJ4.setUp ###Starting testStressRecovery
[junit4:junit4]   2> ASYNC  NEW_CORE C1234 name=collection1 org.apache.solr.core.SolrCore@1692bb29
[junit4:junit4]   2> 3266275 T10239 C1234 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4:junit4]   2> 3266280 T10239 C1234 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79ea706e lockFactory=org.apache.lucene.store.NativeFSLockFactory@5603fb5f),segFN=segments_1,generation=1}
[junit4:junit4]   2> 3266286 T10239 C1234 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 3266289 T10239 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@5733eab6 realtime
[junit4:junit4]   2> 3266290 T10239 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {deleteByQuery=*:* (-9223372036854775807)} 0 16
[junit4:junit4]   2> 3266305 T10239 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 3266307 T10239 C1234 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79ea706e lockFactory=org.apache.lucene.store.NativeFSLockFactory@5603fb5f),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79ea706e lockFactory=org.apache.lucene.store.NativeFSLockFactory@5603fb5f),segFN=segments_2,generation=2}
[junit4:junit4]   2> 3266307 T10239 C1234 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 3266309 T10239 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@1431e7ea main
[junit4:junit4]   2> 3266309 T10239 C1234 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3266312 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1431e7ea main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3266314 T10239 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 9
[junit4:junit4]   2> 3266368 T10241 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4:junit4]   2> 3266374 T10241 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@50a76435 main
[junit4:junit4]   2> 3266374 T10241 C1234 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3266376 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@50a76435 main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3266377 T10241 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 9
[junit4:junit4]   2> 3266396 T10245 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 3266399 T10245 C1234 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 3266416 T10245 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@7a4da7c2 main
[junit4:junit4]   2> 3266417 T10245 C1234 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3266418 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266420 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7a4da7c2 main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3266421 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=2&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266422 T10245 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 26
[junit4:junit4]   2> 3266423 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=3
[junit4:junit4]   2> 3266422 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266424 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=5
[junit4:junit4]   2> 3266424 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:3&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266427 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=48&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266426 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:19&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266428 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=25&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266427 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266429 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266429 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:60&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266431 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266430 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266432 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266431 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:1&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266433 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=59&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266432 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266434 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=36&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266434 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:16&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266435 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=22&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266434 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=11&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266436 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266436 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=46&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266437 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266436 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=52&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266438 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266438 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=51&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266439 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=14&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266439 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:29&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266441 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:1&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266440 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266442 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266441 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266443 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=52&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266442 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:57&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266444 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:3&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266443 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=31&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266445 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266445 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=27&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266446 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266445 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266447 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266447 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=49&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266449 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266448 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266451 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=61&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266450 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266449 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266452 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=46&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266451 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:13&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266454 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266452 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266454 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=11&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266454 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266455 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266455 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266456 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266456 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266457 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266456 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=35&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266458 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=10&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266459 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266460 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:21&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266461 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266462 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=26&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266462 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=25&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266463 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266464 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266464 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266465 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266466 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=26&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266466 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266467 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=60&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266468 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=1&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266458 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=37&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266469 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=53&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266469 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:29&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266470 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=15&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266470 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=44&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266471 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=11&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266471 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=49&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266472 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=13&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266472 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266472 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=6&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266473 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=34&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266460 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=26&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266474 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266473 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266468 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266475 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266477 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=14&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266478 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=52&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266479 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266479 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266480 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:21&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266481 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:15&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266481 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=31&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266482 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=1&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266483 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:17&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266484 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266485 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:4&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266485 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=1&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266486 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266487 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266488 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:17&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266475 T10244 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4:junit4]   2> 3266475 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=51&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266511 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:45&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266512 T10244 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@6ed9ccf1 main
[junit4:junit4]   2> 3266513 T10244 C1234 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3266515 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6ed9ccf1 main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3266515 T10244 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 43
[junit4:junit4]   2> 3266488 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=60&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266530 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266530 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266531 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=43&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266532 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:14&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266533 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266533 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=46&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266534 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=54&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266537 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=49&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266539 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266539 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266540 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266541 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:18&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266541 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266542 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266542 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=35&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266543 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=6&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266477 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266544 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:61&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266545 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:35&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266546 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266546 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266547 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266548 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266549 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:13&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266549 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:56&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266550 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=41&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266550 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:8&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266551 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=17&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266551 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266552 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=28&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266543 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=53&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266554 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=28&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266555 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266556 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:12&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266557 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266558 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266558 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266559 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:26&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266560 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:53&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266561 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:54&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266562 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266562 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=25&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266563 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=23&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266564 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=36&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266564 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266565 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266566 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266567 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=26&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266568 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:59&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266569 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=52&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266569 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=31&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266570 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266571 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266571 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=5&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266571 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266572 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:19&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266573 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266573 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266575 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266575 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=1&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266576 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:19&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266580 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266580 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=35&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266581 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=52&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266582 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266583 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=31&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266583 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266584 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266585 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:13&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266530 T10244 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4:junit4]   2> 3266596 T10244 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@238349ad main
[junit4:junit4]   2> 3266597 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:47&wt=json} hits=0 status=0 QTime=2
[junit4:junit4]   2> 3266512 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266598 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@238349ad main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3266597 T10244 C1234 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3266599 T10244 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 69
[junit4:junit4]   2> 3266601 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=15&qt=/get&wt=json} status=0 QTime=3
[junit4:junit4]   2> 3266602 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=22&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266602 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=15&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266603 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266604 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=48&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266604 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=60&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266605 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=54&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266606 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:59&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266606 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266607 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:43&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266608 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266609 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266610 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266611 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266611 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=41&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266612 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=33&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266613 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=30&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266613 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:49&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266614 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=37&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266614 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=46&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266615 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266616 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:18&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266617 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=44&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266618 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266618 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=53&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266619 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266620 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266621 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266554 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:46&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266623 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266624 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:35&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266624 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266625 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:32&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266631 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266631 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=29&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266632 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266633 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=27&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266633 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266634 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266634 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=19&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266635 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:42&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266636 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266637 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=51&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266637 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266639 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:27&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266640 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=43&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266640 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266641 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=17&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266642 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=10&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266642 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266643 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266644 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266644 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266645 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:25&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266612 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=14
[junit4:junit4]   2> 3266646 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266647 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=16&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266647 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:20&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266648 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266648 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=27&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266649 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266649 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266649 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=11&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266650 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266650 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:57&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266651 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:45&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266652 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=31&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266653 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=43&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266654 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266654 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=5&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266655 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266611 T10244 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 3266659 T10244 C1234 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 3266656 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:34&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266660 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266661 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:18&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266661 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:30&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266662 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=45&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266664 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266664 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=10&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266665 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:15&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266666 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=53&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266667 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266667 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266668 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266668 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266669 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266671 T10244 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@754a1c8e main
[junit4:junit4]   2> 3266672 T10244 C1234 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3266646 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266674 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@754a1c8e main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3266676 T10244 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 65
[junit4:junit4]   2> 3266638 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266684 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:21&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266685 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266696 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=45&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266697 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266698 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=43&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266699 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266700 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=45&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266700 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=10&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266704 T10243 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4:junit4]   2> 3266705 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=16&qt=/get&wt=json} status=0 QTime=4
[junit4:junit4]   2> 3266705 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=36&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266706 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266707 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:4&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266708 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266708 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266709 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266710 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266711 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266711 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266712 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=23&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266713 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:6&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266714 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=25&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266715 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=41
[junit4:junit4]   2> 3266715 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:35&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266716 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=15&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266716 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=17&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266717 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266718 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:19&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266719 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=60&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266720 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266721 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:25&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266721 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266722 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=17&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266723 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266724 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266725 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266725 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266726 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:32&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266726 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=55&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266727 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=6&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266727 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=60&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266727 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=60&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266728 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:11&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266728 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266729 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=1&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266730 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266730 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=29&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266736 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266737 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266737 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=45&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266738 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266738 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=15&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266739 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=29&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266739 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266739 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=43&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266740 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266740 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:9&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266741 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266741 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266742 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266743 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:11&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266747 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266748 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=48&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266749 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266749 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=42&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266750 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=30&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266751 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266751 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:33&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266671 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=9&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266753 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266753 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266754 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266754 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=42&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266755 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=55&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266756 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=9&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266757 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:49&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266762 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266725 T10243 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@35e9f2a main
[junit4:junit4]   2> 3266764 T10243 C1234 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3266765 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=1&qt=/get&wt=json} status=0 QTime=2
[junit4:junit4]   2> 3266766 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266767 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266769 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@35e9f2a main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3266715 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266771 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266772 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:34&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266773 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=41&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266773 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=1&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266773 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=29&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266774 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266775 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=23&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266775 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266776 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:10&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266777 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=49&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266777 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266778 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=25&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266779 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:7&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266779 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=9&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266780 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266781 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=22&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266782 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266782 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=35&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266783 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266761 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=43&qt=/get&wt=json} status=0 QTime=9
[junit4:junit4]   2> 3266784 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266784 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:7&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266785 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:2&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266785 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266786 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266787 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266787 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=53&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266796 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:33&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266796 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=5&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266797 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266797 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266798 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266803 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266804 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:54&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266806 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266806 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:9&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266807 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266808 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=5&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266783 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266814 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:35&wt=json} hits=0 status=0 QTime=5
[junit4:junit4]   2> 3266815 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266815 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266816 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266817 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266817 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=52&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266818 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=33&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266819 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266820 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=51&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266820 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:55&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266821 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266822 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266823 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:24&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266824 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:51&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266825 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=51&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266826 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266826 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266827 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=51&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266827 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266828 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266828 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=57&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266829 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=22&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266829 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=30&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266830 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266773 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=6
[junit4:junit4]   2> 3266831 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=15&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266831 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266837 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=60&qt=/get&wt=json} status=0 QTime=2
[junit4:junit4]   2> 3266773 T10243 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 70
[junit4:junit4]   2> 3266808 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266846 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266847 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=33&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266848 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=54&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266849 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:57&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266850 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266850 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=25&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266851 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=51&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266853 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266853 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266854 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266855 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266859 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:28&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266859 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:50&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266860 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=38&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266861 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=16&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266861 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266862 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:8&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266862 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=44&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266863 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=27&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266864 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266830 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:4&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266865 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=33&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266866 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266871 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=34&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266872 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266872 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=6&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266872 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=57&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266873 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266873 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=51&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266874 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266875 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266876 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266877 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266878 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:38&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266879 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266879 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:53&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266880 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=2&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266881 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266852 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=14
[junit4:junit4]   2> 3266889 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:54&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266890 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=51&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266891 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266892 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=31&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266892 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266893 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=45&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266895 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266895 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=28&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266896 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=11&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266896 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266897 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266898 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=22&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266898 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=27&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266899 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:40&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266900 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=51&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266900 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266901 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=44&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266901 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=16&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266902 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=54&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266902 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:39&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266903 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266903 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266904 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=28&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266904 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:18&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266905 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266905 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266906 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266906 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266907 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:8&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266907 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=36&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266908 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:22&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266908 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:3&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266909 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=45&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266909 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=59&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266909 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266910 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:50&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266911 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:35&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266911 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266912 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=45&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266913 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:33&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266913 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=13&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266914 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=29&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266914 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266915 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266916 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266875 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=22&qt=/get&wt=json} status=0 QTime=11
[junit4:junit4]   2> 3266916 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:54&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266917 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266917 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266918 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=13&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266918 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:11&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266919 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=26&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266919 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266920 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:39&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266920 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266920 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266921 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=55&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266921 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266922 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266922 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=35&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266923 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:35&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266923 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266924 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=54&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266924 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:49&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266925 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266925 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=40&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266926 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266863 T10243 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4:junit4]   2> 3266938 T10243 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@49b0d22e main
[junit4:junit4]   2> 3266926 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=38&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266939 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:25&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266940 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=42&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266940 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266941 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266941 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=2&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266942 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=53&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266942 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=17&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266943 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=2&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266943 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=29&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266943 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=54&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266944 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=11&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266944 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266945 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266945 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:55&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266946 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:20&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266946 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=40&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266947 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266947 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266948 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=41&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266949 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=37&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266916 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=10&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266894 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:20&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266957 T10243 C1234 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3266953 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49b0d22e main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3266978 T10243 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 116
[junit4:junit4]   2> 3266982 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:51&wt=json} hits=0 status=0 QTime=11
[junit4:junit4]   2> 3266983 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266984 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:29&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266985 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=21
[junit4:junit4]   2> 3266985 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266986 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266986 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:21&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266987 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:36&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3266987 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266988 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=45&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266988 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:40&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266988 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:56&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266989 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266989 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:12&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266990 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=17&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266990 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:2&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266991 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:14&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3266991 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=60&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266992 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=1&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266992 T10242 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 3266992 T10242 C1234 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 3266993 T10242 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@b39b922 main
[junit4:junit4]   2> 3266993 T10242 C1234 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3266994 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b39b922 main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3266985 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3266995 T10242 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 3
[junit4:junit4]   2> 3266992 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=32
[junit4:junit4]   2> 3267006 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=54&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267007 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=1&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267008 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267008 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:12&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267009 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267009 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267010 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:15&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267010 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=35&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267011 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267012 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:15&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267013 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267013 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=57&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267016 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=41&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267017 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=42&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3266992 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:14&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267018 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=30&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267019 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=23&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267019 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=16&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267021 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267021 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267022 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:31&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267022 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267023 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=26&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267023 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267024 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267024 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=61&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267025 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267025 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:16&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267025 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267026 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267026 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:31&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267027 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267027 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267008 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:28&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267029 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=27&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267030 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=5&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267030 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267031 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:18&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267032 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267032 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:26&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267033 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267033 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267034 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267034 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267035 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267036 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:38&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267036 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=29&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267037 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:39&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267038 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267038 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267039 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=28&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267040 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267041 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=59&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267042 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:9&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267042 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267044 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:37&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267045 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:37&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267045 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=37&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267046 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267046 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=22&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267047 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267048 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267048 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=17&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267049 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267049 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267051 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=45&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267051 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267052 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267052 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267053 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=28&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267053 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:40&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267054 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267055 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:44&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267055 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267056 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=59&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267057 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:39&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267057 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267058 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=14&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267058 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267059 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=13&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267059 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:1&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267061 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267061 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267062 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:25&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267062 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267063 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267063 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:43&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267064 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:59&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267064 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267064 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267065 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267065 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267065 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=6&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267066 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267067 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267067 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267068 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=55&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267019 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267069 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=55&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267070 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=4&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267071 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267071 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:49&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267072 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:14&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267072 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:33&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267073 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267074 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267075 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267076 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=55&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267076 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=42&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267077 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267077 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267078 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:13&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267081 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=55&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267082 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267082 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=9&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267083 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267084 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267084 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267085 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=4&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267085 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=10&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267086 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=2&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267087 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:26&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267087 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=55&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267088 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267088 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=40&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267089 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267090 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=46&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267090 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=31&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267091 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=53&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267092 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267040 T10242 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 3267093 T10242 C1234 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 3267040 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267105 T10242 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@92efdd3 main
[junit4:junit4]   2> 3267105 T10242 C1234 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3267093 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267079 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=10
[junit4:junit4]   2> 3267107 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@92efdd3 main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3267114 T10242 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 74
[junit4:junit4]   2> 3267114 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=9
[junit4:junit4]   2> 3267120 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267120 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267121 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:17&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267122 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=22&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267123 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=44&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267123 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267124 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267125 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=13&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267125 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267126 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:54&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267127 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267127 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=22&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267128 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267128 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=28&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267128 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:19&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267129 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267129 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:25&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267130 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=29&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267130 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=30&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267131 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=16&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267131 T10242 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 3267132 T10242 C1234 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 3267133 T10242 C1234 oass.SolrIndexSearcher.<init> Opening Searcher@2a560028 main
[junit4:junit4]   2> 3267114 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=5&qt=/get&wt=json} status=0 QTime=7
[junit4:junit4]   2> 3267114 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=7
[junit4:junit4]   2> 3267134 T10242 C1234 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3267132 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=37&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267136 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a560028 main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3267138 T10242 C1234 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 7
[junit4:junit4]   2> 3267139 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=2
[junit4:junit4]   2> 3267139 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=16&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267140 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267140 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:5&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267141 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267142 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:3&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267142 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=43&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267143 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267144 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267144 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=54&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267145 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=42&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267146 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267147 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:27&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267148 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267148 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267149 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267150 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:24&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267151 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=61&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267149 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=13&qt=/get&wt=json} status=0 QTime=13
[junit4:junit4]   2> 3267152 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:29&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267152 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=25&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267153 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267153 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267154 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=49&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267154 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267155 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:52&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267155 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=48&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267156 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:43&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267156 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267156 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=42&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267157 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267158 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=16&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267159 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:56&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267159 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:3&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267159 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267160 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267160 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=61&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267161 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:56&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267161 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=40&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267162 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267162 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:15&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267162 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=41&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267163 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267163 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267164 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:32&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267164 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=54&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267165 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267165 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=55&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267166 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=16&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267166 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=25&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267167 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267167 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267168 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267169 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=33&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267169 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267170 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267171 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267172 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267172 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=4&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267173 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267174 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=6&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267174 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267174 T10252 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:38&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267151 T10251 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267151 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=48&qt=/get&wt=json} status=0 QTime=16
[junit4:junit4]   2> 3267176 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:42&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267176 T10250 C1234 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:18&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267151 T10242 C1234 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> ASYNC  NEW_CORE C1235 name=collection1 org.apache.solr.core.SolrCore@1692bb29
[junit4:junit4]   2> 3267198 T10242 C1235 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 3267198 T10242 C1235 oass.SolrIndexSearcher.<init> Opening Searcher@67964225 main
[junit4:junit4]   2> 3267199 T10242 C1235 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3267200 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@67964225 main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3267201 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267202 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267202 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267203 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=40&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267203 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=4&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267204 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267205 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=13&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267205 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267206 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267206 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267207 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267208 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:22&wt=json} hits=0 status=0 QTime=8
[junit4:junit4]   2> 3267209 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267212 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=46&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267208 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=6&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267216 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=15
[junit4:junit4]   2> 3267216 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=16&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267215 T10242 C1235 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 64
[junit4:junit4]   2> 3267215 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=1&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267219 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=26&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267220 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=28&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267221 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267221 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=60&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267222 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267223 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=28&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267224 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=37&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267224 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:33&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267225 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267225 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267226 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=45&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267226 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267227 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267217 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267228 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267229 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=11&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267229 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=25&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267229 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=26&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267230 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267230 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=52&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267231 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267232 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267232 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267232 T10242 C1235 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 3267233 T10242 C1235 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 3267216 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:44&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267241 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267241 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267242 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267243 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=61&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267243 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=53&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267244 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:50&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267244 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:4&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267244 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=2&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267245 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267245 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267245 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267232 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=4
[junit4:junit4]   2> 3267246 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=33&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267247 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=37&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267247 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=42&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267248 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:53&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267249 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:4&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267256 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=19&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267257 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267258 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=13&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267258 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=31&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267258 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267259 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:44&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267259 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267259 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267260 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=10&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267260 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267261 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=32&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267261 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=34&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267261 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267262 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267262 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:45&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267264 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:36&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267264 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267265 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267265 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:23&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267266 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:60&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267267 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:24&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267267 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=35&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267268 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=36&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267268 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:50&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267269 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=6&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267269 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:29&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267270 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267271 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:36&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267271 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267232 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267272 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=58&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267273 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:40&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267279 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267280 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=10&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267280 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=31&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267281 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:22&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267282 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:46&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267283 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=9&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267283 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267284 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:29&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267285 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:25&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267285 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=37&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267286 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=25&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267287 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267288 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:52&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267288 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=53&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267289 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267290 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=57&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267290 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=46&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267291 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267291 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267292 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267292 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267292 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=25&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267293 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267293 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267293 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267294 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267295 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:10&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267295 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=55&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267296 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267296 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267298 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=4&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267299 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:54&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267299 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=27&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267300 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267300 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:47&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267303 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=2
[junit4:junit4]   2> 3267307 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267310 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=52&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267311 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=24&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267311 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:18&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267312 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267312 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=11&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267312 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267313 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267313 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267313 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267314 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267314 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=14&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267315 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:33&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267315 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267316 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=19&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267316 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=26&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267317 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267317 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:3&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267318 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:49&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267272 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267321 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:42&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267322 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267323 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267324 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267325 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=9&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267326 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267332 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=34&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267333 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=48&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267333 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267334 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267334 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267335 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=43&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267335 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267336 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:39&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267336 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=40&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267336 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267337 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=35&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267337 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=59&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267338 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:52&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267339 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:54&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267340 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:26&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267340 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:45&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267341 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267342 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:36&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267343 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=48&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267343 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267344 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267345 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267345 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267353 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=23&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267354 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=46&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267354 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=51&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267246 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=5&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267355 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:3&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267356 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=60&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267356 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:56&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267356 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267357 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=19&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267357 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267358 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=53&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267358 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=29&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267358 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267360 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267360 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=13&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267360 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=1&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267361 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=52&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267361 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267362 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:38&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267362 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:20&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267363 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=9&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267366 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:42&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267367 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:22&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267368 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=41&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267369 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=35&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267369 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267370 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=33&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267370 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:31&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267371 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267371 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:13&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267372 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:58&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267372 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=26&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267373 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=29&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267378 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:22&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267243 T10242 C1235 oass.SolrIndexSearcher.<init> Opening Searcher@37fece03 main
[junit4:junit4]   2> 3267384 T10242 C1235 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 3267379 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=37&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267355 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267321 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=2
[junit4:junit4]   2> 3267391 T10240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@37fece03 main{StandardDirectoryReader(segments_1:2:nrt)}
[junit4:junit4]   2> 3267396 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=55&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267397 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=35&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267399 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267399 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267400 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267401 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:40&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267401 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267402 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=14&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267402 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=30&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267403 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=42&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267403 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=12&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267404 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=18&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267405 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:13&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267400 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:56&wt=json} hits=0 status=0 QTime=7
[junit4:junit4]   2> 3267406 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267407 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=34&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267407 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:48&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267408 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:46&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267410 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=37&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267410 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267411 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267411 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=52&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267412 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267412 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267413 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267414 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=20&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267414 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=22&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267415 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267424 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:35&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267425 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=23&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267426 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267426 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:5&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267427 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267427 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267428 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=54&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267429 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267430 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=4&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267431 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=40&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267431 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=50&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267432 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=31&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267433 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=56&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267400 T10242 C1235 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 168
[junit4:junit4]   2> 3267435 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=33&qt=/get&wt=json} status=0 QTime=2
[junit4:junit4]   2> 3267436 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=17&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267437 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:8&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267437 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267438 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267439 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267440 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267441 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=41&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267441 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=26&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267442 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267442 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=38&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267443 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=39&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267444 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=47&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267444 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=61&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267445 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267446 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267447 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:52&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267447 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:41&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267448 T10251 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=52&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267416 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=22
[junit4:junit4]   2> 3267452 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=6&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267452 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267410 T10252 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=30&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267453 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=21&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267454 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=8&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267455 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:42&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267455 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=3&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267456 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=15&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267457 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267457 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=17&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267458 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267459 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:57&wt=json} hits=0 status=0 QTime=0
[junit4:junit4]   2> 3267459 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267460 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=7&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267460 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=43&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267461 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=16&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267461 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=5&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267462 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267463 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=53&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267463 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267469 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=1
[junit4:junit4]   2> 3267475 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={omitHeader=true&q=id:0&wt=json} hits=0 status=0 QTime=1
[junit4:junit4]   2> 3267475 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267476 T10250 C1235 oasc.SolrCore.execute [collection1] webapp=null path=null params={ids=0&qt=/get&wt=json} status=0 QTime=0
[junit4:junit4]   2> 3267482

[...truncated too long message...]

tor.java:615)
[junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:724)
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=DefaultSimilarity, locale=sl_SI, timezone=Portugal
[junit4:junit4]   2> NOTE: Mac OS X 10.8.4 x86_64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=2,threads=1,free=247912352,total=511180800
[junit4:junit4]   2> NOTE: All tests run in this JVM: [RequiredFieldsTest, MultiTermTest, DirectUpdateHandlerOptimizeTest, TestFieldResource, RecoveryZkTest, QueryParsingTest, SolrInfoMBeanTest, UUIDFieldTest, TestSolrQueryParser, HdfsSyncSliceTest, TestRemoteStreaming, QueryElevationComponentTest, TestSchemaResource, SuggesterTest, ChaosMonkeyNothingIsSafeTest, TestLazyCores, ClusterStateTest, ScriptEngineTest, PrimitiveFieldTypeTest, TestWordDelimiterFilterFactory, TestLRUCache, SampleTest, TestFunctionQuery, DefaultValueUpdateProcessorTest, TestIndexSearcher, TestCoreContainer, TestDistributedSearch, IndexSchemaTest, TestFiltering, TestPhraseSuggestions, TestFastWriter, CollectionsAPIDistributedZkTest, IndexReaderFactoryTest, TestArbitraryIndexDir, NotRequiredUniqueKeyTest, TestSolrQueryParserResource, BasicHdfsTest, SliceStateUpdateTest, RegexBoostProcessorTest, TestSolrXml, AliasIntegrationTest, SolrIndexSplitterTest, SignatureUpdateProcessorFactoryTest, BlockCacheTest, UniqFieldsUpdateProcessorFactoryTest, FileUtilsTest, TestDocSet, BasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest, SolrRequestParserTest, FieldAnalysisRequestHandlerTest, CurrencyFieldXmlFileTest, LeaderElectionTest, TestSolrQueryParserDefaultOperatorResource, TestUniqueKeyFieldResource, HdfsUnloadDistributedZkTest, SuggesterWFSTTest, MBeansHandlerTest, TestIndexingPerformance, XmlUpdateRequestHandlerTest, TestCodecSupport, TestPerFieldSimilarity, PolyFieldTest, TestCopyFieldCollectionResource, DOMUtilTest, DocumentBuilderTest, DirectUpdateHandlerTest, PathHierarchyTokenizerFactoryTest, TestAddFieldRealTimeGet, TestSuggestSpellingConverter, TestReplicationHandler, BinaryUpdateRequestHandlerTest, SolrIndexConfigTest, DocumentAnalysisRequestHandlerTest, ZkControllerTest, TestQueryUtils, OutputWriterTest, LukeRequestHandlerTest, SolrCoreCheckLockOnStartupTest, TestCoreDiscovery, TestSystemIdResolver, TestFuzzyAnalyzedSuggestions, TestPseudoReturnFields, SolrCmdDistributorTest, TestPluginEnable, TestQuerySenderNoQuery, OpenCloseCoreStressTest, ZkCLITest, BasicDistributedZkTest, TestReload, TestSweetSpotSimilarityFactory, DirectSolrConnectionTest, TestRandomFaceting, TermsComponentTest, TestBinaryResponseWriter, TestPartialUpdateDeduplication, DirectSolrSpellCheckerTest, TestLMDirichletSimilarityFactory, TestPostingsSolrHighlighter, SpellPossibilityIteratorTest, LoggingHandlerTest, TestRangeQuery, AlternateDirectoryTest, NoCacheHeaderTest, FieldMutatingUpdateProcessorTest, PluginInfoTest, CurrencyFieldOpenExchangeTest, BadComponentTest, DateMathParserTest, TestUpdate, CacheHeaderTest, TestJoin, TestCollationField, TestLFUCache, TestCloudManagedSchemaAddField, SortByFunctionTest, PingRequestHandlerTest, SolrTestCaseJ4Test, ShardRoutingCustomTest, LegacyHTMLStripCharFilterTest, TestAtomicUpdateErrorCases, TestRecoveryHdfs, TestValueSourceCache, EchoParamsTest, XsltUpdateRequestHandlerTest, HardAutoCommitTest, TestReloadAndDeleteDocs, TestCSVResponseWriter, SimpleFacetsTest, TestFastLRUCache, TestDistributedGrouping, TestStressLucene, SpellingQueryConverterTest, TestFaceting, SimplePostToolTest, TestBadConfig, PrimUtilsTest, HighlighterConfigTest, StatsComponentTest, TestManagedSchemaFieldResource, TermVectorComponentTest, ParsingFieldUpdateProcessorsTest, BlockDirectoryTest, BasicFunctionalityTest, HdfsBasicDistributedZkTest, DateFieldTest, StatelessScriptUpdateProcessorFactoryTest, TestSolrXMLSerializer, ZkSolrClientTest, CoreAdminHandlerTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, SyncSliceTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, TestZkChroot, TestRandomDVFaceting, AutoCommitTest, TestRecovery, TestHashPartitioner, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestRealTimeGet, TestStressReorder, TestMultiCoreConfBootstrap, TestStressVersions, DistributedTermsComponentTest, TestSolr4Spatial, SolrCoreTest, SpellCheckComponentTest, TestGroupingSearch, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, OverseerCollectionProcessorTest, HighlighterTest, SoftAutoCommitTest, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, SpellCheckCollatorTest, SuggesterFSTTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTSTTest, TestTrie, SpatialFilterTest, TestCSVLoader, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, QueryEqualityTest, DocValuesMultiTest, DistanceFunctionTest, TestSolrDeletionPolicy1, DebugComponentTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, StandardRequestHandlerTest, TestWriterPerf, TestReversedWildcardFilterFactory, TestQueryTypes, TestOmitPositions, FileBasedSpellCheckerTest, RequestHandlersTest, MoreLikeThisHandlerTest, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, SolrPluginUtilsTest, TestJmxIntegration, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, JSONWriterTest, TestAnalyzedSuggestions, JsonLoaderTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestComponentsName, SearchHandlerTest, CoreContainerCoreInitFailuresTest, SOLR749Test, TestPropInject, TestQuerySenderListener, TestPropInjectDefaults, UpdateParamsTest, TestSolrIndexConfig, CopyFieldTest, ResponseLogComponentTest, TestStressRecovery]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestStressRecovery -Dtests.seed=FB1DF1E4B083C777 -Dtests.slow=true -Dtests.locale=sl_SI -Dtests.timezone=Portugal -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR   0.00s | TestStressRecovery (suite) <<<
[junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.search.TestStressRecovery:
[junit4:junit4]    >    1) Thread[id=10259, name=IPC Parameter Sending Thread #6, state=TIMED_WAITING, group=TGRP-HdfsSyncSliceTest]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:724)
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([FB1DF1E4B083C777]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4:junit4]    >    1) Thread[id=10259, name=IPC Parameter Sending Thread #6, state=TIMED_WAITING, group=TGRP-HdfsSyncSliceTest]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:724)
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([FB1DF1E4B083C777]:0)
[junit4:junit4] Completed in 272.43s, 1 test, 2 errors <<< FAILURES!

[...truncated 226 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:386: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:366: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:190: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:443: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1243: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:887: There were test failures: 312 suites, 1315 tests, 2 suite-level errors, 175 ignored (10 assumptions)

Total time: 104 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 601 - Still Failing!

Policeman Jenkins Server-2
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/601/
Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
shard1 is not consistent.  Got 305 from http://127.0.0.1:50609/u/lk/collection1lastClient and got 267 from http://127.0.0.1:50616/u/lk/collection1

Stack Trace:
java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:50609/u/lk/collection1lastClient and got 267 from http://127.0.0.1:50616/u/lk/collection1
        at __randomizedtesting.SeedInfo.seed([D274AC0DBA3A6188:53922215CD6501B4]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1045)
        at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:237)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at java.lang.Thread.run(Thread.java:724)




Build Log:
[...truncated 9601 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 2255608 T3972 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /u/lk
[junit4:junit4]   2> 2255617 T3972 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1372333316965
[junit4:junit4]   2> 2255619 T3972 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 2255621 T3973 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 2255721 T3972 oasc.ZkTestServer.run start zk server on port:50602
[junit4:junit4]   2> 2255724 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2255730 T3979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d69627b name:ZooKeeperConnection Watcher:127.0.0.1:50602 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2255731 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2255731 T3972 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 2255745 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2255749 T3981 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37be1397 name:ZooKeeperConnection Watcher:127.0.0.1:50602/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2255749 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2255749 T3972 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 2255756 T3972 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 2255762 T3972 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 2255767 T3972 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 2255777 T3972 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 2255778 T3972 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 2255797 T3972 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 2255798 T3972 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 2255806 T3972 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 2255807 T3972 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 2255813 T3972 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 2255814 T3972 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 2255820 T3972 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 2255820 T3972 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 2255826 T3972 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 2255827 T3972 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 2255832 T3972 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 2255833 T3972 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 2255839 T3972 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 2255840 T3972 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 2255852 T3972 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 2255853 T3972 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 2256353 T3972 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 2256361 T3972 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50605
[junit4:junit4]   2> 2256362 T3972 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2256363 T3972 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2256363 T3972 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372333317211
[junit4:junit4]   2> 2256363 T3972 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372333317211/solr.xml
[junit4:junit4]   2> 2256364 T3972 oasc.CoreContainer.<init> New CoreContainer 1072365715
[junit4:junit4]   2> 2256364 T3972 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372333317211/'
[junit4:junit4]   2> 2256365 T3972 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372333317211/'
[junit4:junit4]   2> 2256529 T3972 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 2256529 T3972 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2256530 T3972 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2256530 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2256531 T3972 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2256531 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2256532 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2256532 T3972 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2256533 T3972 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2256533 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2256553 T3972 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 2256554 T3972 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50602/solr
[junit4:junit4]   2> 2256555 T3972 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2256557 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2256562 T3992 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4657bd32 name:ZooKeeperConnection Watcher:127.0.0.1:50602 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2256563 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2256569 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 2256587 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2256569 T3974 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f85709b700002, likely client has closed socket
[junit4:junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4]   2>
[junit4:junit4]   2> 2256600 T3994 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43d55ceb name:ZooKeeperConnection Watcher:127.0.0.1:50602/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2256600 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2256605 T3972 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 2256618 T3972 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 2256627 T3972 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 2256633 T3972 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50605_u%2Flk
[junit4:junit4]   2> 2256635 T3972 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50605_u%2Flk
[junit4:junit4]   2> 2256644 T3972 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 2256663 T3972 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 2256674 T3972 oasc.Overseer.start Overseer (id=89937236261339139-127.0.0.1:50605_u%2Flk-n_0000000000) starting
[junit4:junit4]   2> 2256681 T3972 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 2256691 T3996 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 2256694 T3972 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 2256704 T3972 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 2256710 T3972 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 2256741 T3995 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 2256749 T3997 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2256750 T3997 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2256753 T3997 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4]   2> 2258250 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2258252 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50605_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50605/u/lk"}
[junit4:junit4]   2> 2258252 T3995 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2258253 T3995 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2258271 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2258756 T3997 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4]   2> 2258757 T3997 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372333317211/collection1
[junit4:junit4]   2> 2258757 T3997 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 2258758 T3997 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2258759 T3997 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 2258762 T3997 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372333317211/collection1/'
[junit4:junit4]   2> 2258763 T3997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372333317211/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2258767 T3997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372333317211/collection1/lib/README' to classloader
[junit4:junit4]   2> 2258860 T3997 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2259009 T3997 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2259013 T3997 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 2259020 T3997 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 2259930 T3997 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2259948 T3997 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2259953 T3997 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2259995 T3997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2260006 T3997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2260014 T3997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2260017 T3997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2260018 T3997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 2260018 T3997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2260022 T3997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2260022 T3997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 2260023 T3997 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 2260023 T3997 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372333317211/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372333316964/control/data/
[junit4:junit4]   2> 2260024 T3997 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@28e04e24
[junit4:junit4]   2> 2260025 T3997 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372333316964/control/data
[junit4:junit4]   2> 2260026 T3997 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372333316964/control/data/index/
[junit4:junit4]   2> 2260026 T3997 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372333316964/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2260027 T3997 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372333316964/control/data/index
[junit4:junit4]   2> 2260040 T3997 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5906bda6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@131117ce),segFN=segments_1,generation=1}
[junit4:junit4]   2> 2260042 T3997 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 2260048 T3997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2260049 T3997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2260050 T3997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2260051 T3997 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2260052 T3997 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2260053 T3997 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2260053 T3997 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2260054 T3997 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2260055 T3997 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2260085 T3997 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2260094 T3997 oass.SolrIndexSearcher.<init> Opening Searcher@a51f2cd main
[junit4:junit4]   2> 2260096 T3997 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2260096 T3997 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2260109 T3998 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a51f2cd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2260113 T3997 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2260114 T3997 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50605/u/lk collection:control_collection shard:shard1
[junit4:junit4]   2> 2260116 T3997 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2260135 T3997 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4:junit4]   2> 2260149 T3997 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2260150 T3997 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2260150 T3997 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50605/u/lk/collection1/
[junit4:junit4]   2> 2260150 T3997 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2260151 T3997 oasc.SyncStrategy.syncToMe http://127.0.0.1:50605/u/lk/collection1/ has no replicas
[junit4:junit4]   2> 2260151 T3997 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50605/u/lk/collection1/ shard1
[junit4:junit4]   2> 2260151 T3997 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2261297 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2261348 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2261410 T3997 oasc.ZkController.register We are http://127.0.0.1:50605/u/lk/collection1/ and leader is http://127.0.0.1:50605/u/lk/collection1/
[junit4:junit4]   2> 2261411 T3997 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50605/u/lk
[junit4:junit4]   2> 2261411 T3997 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2261411 T3997 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2261411 T3997 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2261415 T3997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2261417 T3972 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2261418 T3972 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2261418 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2261442 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 2261445 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2261449 T4001 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ef9037 name:ZooKeeperConnection Watcher:127.0.0.1:50602/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2261450 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2261453 T3972 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 2261459 T3972 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 2261870 T3972 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 2261877 T3972 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50609
[junit4:junit4]   2> 2261878 T3972 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2261878 T3972 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2261879 T3972 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372333322805
[junit4:junit4]   2> 2261879 T3972 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372333322805/solr.xml
[junit4:junit4]   2> 2261880 T3972 oasc.CoreContainer.<init> New CoreContainer 937461520
[junit4:junit4]   2> 2261881 T3972 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372333322805/'
[junit4:junit4]   2> 2261881 T3972 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372333322805/'
[junit4:junit4]   2> 2262056 T3972 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 2262057 T3972 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2262057 T3972 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2262058 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2262058 T3972 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2262059 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2262059 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2262059 T3972 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2262060 T3972 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2262060 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2262080 T3972 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 2262083 T3972 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50602/solr
[junit4:junit4]   2> 2262087 T3972 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2262089 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2262095 T4012 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2cc79203 name:ZooKeeperConnection Watcher:127.0.0.1:50602 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2262097 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2262101 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 2262118 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2262127 T4014 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68e7c985 name:ZooKeeperConnection Watcher:127.0.0.1:50602/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2262127 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2262139 T3972 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 2262869 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2262871 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50605_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50605/u/lk"}
[junit4:junit4]   2> 2262884 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2262901 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2262902 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2263153 T3972 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50609_u%2Flk
[junit4:junit4]   2> 2263159 T3972 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50609_u%2Flk
[junit4:junit4]   2> 2263164 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2263164 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2263165 T4014 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2263165 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2263170 T3994 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2263171 T4001 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2263180 T4015 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2263180 T4015 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2263182 T4015 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4]   2> 2264400 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2264402 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50609_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50609/u/lk"}
[junit4:junit4]   2> 2264403 T3995 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 2264403 T3995 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2264412 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2264414 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2264416 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2265184 T4015 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4]   2> 2265184 T4015 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372333322805/collection1
[junit4:junit4]   2> 2265185 T4015 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2265186 T4015 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2265186 T4015 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2265189 T4015 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372333322805/collection1/'
[junit4:junit4]   2> 2265191 T4015 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372333322805/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2265192 T4015 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372333322805/collection1/lib/README' to classloader
[junit4:junit4]   2> 2265260 T4015 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2265339 T4015 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2265342 T4015 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 2265347 T4015 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 2266314 T4015 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2266333 T4015 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2266338 T4015 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2266373 T4015 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2266381 T4015 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2266393 T4015 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2266396 T4015 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2266397 T4015 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 2266397 T4015 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2266400 T4015 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2266400 T4015 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 2266400 T4015 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 2266401 T4015 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372333322805/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty1/
[junit4:junit4]   2> 2266401 T4015 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@28e04e24
[junit4:junit4]   2> 2266402 T4015 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty1
[junit4:junit4]   2> 2266402 T4015 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty1/index/
[junit4:junit4]   2> 2266403 T4015 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2266405 T4015 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty1/index
[junit4:junit4]   2> 2266409 T4015 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b7fe787 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dcc1ab7),segFN=segments_1,generation=1}
[junit4:junit4]   2> 2266409 T4015 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 2266417 T4015 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2266418 T4015 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2266419 T4015 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2266420 T4015 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2266421 T4015 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2266421 T4015 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2266422 T4015 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2266423 T4015 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2266424 T4015 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2266438 T4015 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2266446 T4015 oass.SolrIndexSearcher.<init> Opening Searcher@2c20be69 main
[junit4:junit4]   2> 2266448 T4015 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2266449 T4015 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2266462 T4016 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c20be69 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2266465 T4015 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2266465 T4015 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50609/u/lk collection:collection1 shard:shard1
[junit4:junit4]   2> 2266469 T4015 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 2266487 T4015 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4:junit4]   2> 2266493 T4015 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2266494 T4015 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2266494 T4015 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50609/u/lk/collection1/
[junit4:junit4]   2> 2266495 T4015 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2266495 T4015 oasc.SyncStrategy.syncToMe http://127.0.0.1:50609/u/lk/collection1/ has no replicas
[junit4:junit4]   2> 2266495 T4015 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50609/u/lk/collection1/ shard1
[junit4:junit4]   2> 2266496 T4015 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 2267437 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2267463 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2267463 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2267464 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2267499 T4015 oasc.ZkController.register We are http://127.0.0.1:50609/u/lk/collection1/ and leader is http://127.0.0.1:50609/u/lk/collection1/
[junit4:junit4]   2> 2267500 T4015 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50609/u/lk
[junit4:junit4]   2> 2267500 T4015 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2267500 T4015 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2267501 T4015 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2267504 T4015 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2267507 T3972 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2267508 T3972 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2267508 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2267986 T3972 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 2267996 T3972 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50612
[junit4:junit4]   2> 2268000 T3972 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2268000 T3972 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2268001 T3972 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372333328879
[junit4:junit4]   2> 2268001 T3972 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372333328879/solr.xml
[junit4:junit4]   2> 2268002 T3972 oasc.CoreContainer.<init> New CoreContainer 1143989329
[junit4:junit4]   2> 2268003 T3972 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372333328879/'
[junit4:junit4]   2> 2268003 T3972 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372333328879/'
[junit4:junit4]   2> 2268151 T3972 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 2268152 T3972 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2268153 T3972 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2268153 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2268153 T3972 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2268154 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2268154 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2268155 T3972 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2268155 T3972 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2268156 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2268175 T3972 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 2268176 T3972 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50602/solr
[junit4:junit4]   2> 2268176 T3972 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2268181 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2268345 T4028 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23f109e2 name:ZooKeeperConnection Watcher:127.0.0.1:50602 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2268346 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2268350 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 2268368 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2268373 T4030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@637b0a1d name:ZooKeeperConnection Watcher:127.0.0.1:50602/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2268373 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2268388 T3972 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 2268978 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2268982 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50609_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50609/u/lk"}
[junit4:junit4]   2> 2268995 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2268996 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2268995 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2268995 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2269396 T3972 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50612_u%2Flk
[junit4:junit4]   2> 2269398 T3972 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50612_u%2Flk
[junit4:junit4]   2> 2269408 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2269408 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 2269410 T4014 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2269410 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2269410 T4030 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2269411 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2269414 T3994 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2269433 T4001 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 2269447 T4031 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2269447 T4031 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2269453 T4031 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4]   2> 2270512 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2270513 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node2",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50612_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50612/u/lk"}
[junit4:junit4]   2> 2270514 T3995 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 2270514 T3995 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2270521 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2270521 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2270524 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2270526 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2271454 T4031 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4]   2> 2271455 T4031 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372333328879/collection1
[junit4:junit4]   2> 2271455 T4031 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2271456 T4031 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2271457 T4031 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2271459 T4031 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372333328879/collection1/'
[junit4:junit4]   2> 2271461 T4031 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372333328879/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2271462 T4031 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372333328879/collection1/lib/README' to classloader
[junit4:junit4]   2> 2271532 T4031 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2271619 T4031 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2271623 T4031 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 2271628 T4031 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 2272570 T4031 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2272585 T4031 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2272593 T4031 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2272638 T4031 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2272649 T4031 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2272673 T4031 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2272693 T4031 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2272694 T4031 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 2272695 T4031 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2272697 T4031 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2272698 T4031 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 2272698 T4031 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 2272698 T4031 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372333328879/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty2/
[junit4:junit4]   2> 2272699 T4031 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@28e04e24
[junit4:junit4]   2> 2272700 T4031 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty2
[junit4:junit4]   2> 2272700 T4031 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty2/index/
[junit4:junit4]   2> 2272700 T4031 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2272701 T4031 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty2/index
[junit4:junit4]   2> 2272707 T4031 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2cfd9287 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e3a59d),segFN=segments_1,generation=1}
[junit4:junit4]   2> 2272708 T4031 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 2272712 T4031 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2272712 T4031 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2272734 T4031 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2272740 T4031 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2272741 T4031 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2272741 T4031 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2272742 T4031 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2272744 T4031 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2272744 T4031 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2272776 T4031 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2272803 T4031 oass.SolrIndexSearcher.<init> Opening Searcher@13e06f89 main
[junit4:junit4]   2> 2272804 T4031 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2272805 T4031 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2272824 T4032 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13e06f89 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2272827 T4031 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2272828 T4031 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50612/u/lk collection:collection1 shard:shard1
[junit4:junit4]   2> 2272840 T4031 oasc.ZkController.register We are http://127.0.0.1:50612/u/lk/collection1/ and leader is http://127.0.0.1:50609/u/lk/collection1/
[junit4:junit4]   2> 2272841 T4031 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50612/u/lk
[junit4:junit4]   2> 2272841 T4031 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 2272841 T4031 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C784 name=collection1 org.apache.solr.core.SolrCore@775b3e1d url=http://127.0.0.1:50612/u/lk/collection1 node=127.0.0.1:50612_u%2Flk C784_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:50612_u%2Flk, base_url=http://127.0.0.1:50612/u/lk}
[junit4:junit4]   2> 2272842 T4033 C784 P50612 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 2272842 T4033 C784 P50612 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 2272843 T4033 C784 P50612 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 2272843 T4033 C784 P50612 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2272875 T4033 C784 P50612 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2272882 T4031 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2272905 T3972 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2272905 T3972 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2272906 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2272928 T4007 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 2273518 T3972 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 2273525 T3972 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50616
[junit4:junit4]   2> 2273526 T3972 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2273526 T3972 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2273526 T3972 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372333334271
[junit4:junit4]   2> 2273527 T3972 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372333334271/solr.xml
[junit4:junit4]   2> 2273529 T3972 oasc.CoreContainer.<init> New CoreContainer 1998394993
[junit4:junit4]   2> 2273529 T3972 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372333334271/'
[junit4:junit4]   2> 2273530 T3972 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372333334271/'
[junit4:junit4]   2> 2273573 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2273575 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node2",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50612_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50612/u/lk"}
[junit4:junit4]   2> 2273630 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2273636 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2273637 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2273638 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2273794 T3972 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 2273795 T3972 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2273796 T3972 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2273796 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2273797 T3972 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2273797 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2273798 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2273798 T3972 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2273799 T3972 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2273799 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2273830 T3972 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 2273832 T3972 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50602/solr
[junit4:junit4]   2> 2273832 T3972 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2273835 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2273842 T4045 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e0b0695 name:ZooKeeperConnection Watcher:127.0.0.1:50602 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2273843 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2273852 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 2273876 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2273881 T4047 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10432ba8 name:ZooKeeperConnection Watcher:127.0.0.1:50602/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2273882 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2273901 T3972 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 2273929 T4007 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   2> 2273930 T4007 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node2&state=recovering&nodeName=127.0.0.1:50612_u%252Flk&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4]   2> 2274923 T3972 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50616_u%2Flk
[junit4:junit4]   2> 2274944 T3972 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50616_u%2Flk
[junit4:junit4]   2> 2274952 T4030 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2274952 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2274955 T4047 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2274957 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2274960 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 2274963 T4014 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2274963 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2274967 T4001 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2274967 T3994 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2274977 T4048 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2274978 T4048 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2274980 T4048 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4]   2> 2275171 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2275173 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50616_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50616/u/lk"}
[junit4:junit4]   2> 2275174 T3995 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 2275174 T3995 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2275186 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2275186 T4047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2275192 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2275196 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2275197 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> ASYNC  NEW_CORE C785 name=collection1 org.apache.solr.core.SolrCore@775b3e1d url=http://127.0.0.1:50612/u/lk/collection1 node=127.0.0.1:50612_u%2Flk C785_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:50612_u%2Flk, base_url=http://127.0.0.1:50612/u/lk}
[junit4:junit4]   2> 2275937 T4033 C785 P50612 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50609/u/lk/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 2275937 T4033 C785 P50612 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk START replicas=[http://127.0.0.1:50609/u/lk/collection1/] nUpdates=100
[junit4:junit4]   2> 2275938 T4033 C785 P50612 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 2275940 T4033 C785 P50612 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 2275940 T4033 C785 P50612 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 2275940 T4033 C785 P50612 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 2275940 T4033 C785 P50612 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 2275941 T4033 C785 P50612 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50609/u/lk/collection1/. core=collection1
[junit4:junit4]   2> 2275941 T4033 C785 P50612 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C786 name=collection1 org.apache.solr.core.SolrCore@1f757498 url=http://127.0.0.1:50609/u/lk/collection1 node=127.0.0.1:50609_u%2Flk C786_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50609_u%2Flk, base_url=http://127.0.0.1:50609/u/lk, leader=true}
[junit4:junit4]   2> 2275966 T4007 C786 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 2275970 T4006 C786 P50609 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2275972 T4006 C786 P50609 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b7fe787 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dcc1ab7),segFN=segments_1,generation=1}
[junit4:junit4]   2> 2275973 T4006 C786 P50609 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 2275974 T4006 C786 P50609 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2275975 T4006 C786 P50609 oass.SolrIndexSearcher.<init> Opening Searcher@793c7dbe realtime
[junit4:junit4]   2> 2275975 T4006 C786 P50609 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2275975 T4006 C786 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4]   2> 2275977 T4033 C785 P50612 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 2275977 T4033 C785 P50612 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 2275985 T4048 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4]   2> 2275987 T4048 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372333334271/collection1
[junit4:junit4]   2> 2275987 T4048 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2275988 T4009 C786 P50609 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 2275988 T4009 C786 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 2275988 T4048 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2275989 T4048 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2275989 T4033 C785 P50612 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 2275990 T4033 C785 P50612 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 2275990 T4033 C785 P50612 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2275990 T4033 C785 P50612 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2275992 T4048 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372333334271/collection1/'
[junit4:junit4]   2> 2275994 T4048 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372333334271/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2275994 T4048 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372333334271/collection1/lib/README' to classloader
[junit4:junit4]   2> 2277030 T3976 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 1022ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4:junit4]   2> 2277087 T4033 C785 P50612 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 2277137 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2277154 T4048 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2277163 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node2",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50612_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50612/u/lk"}
[junit4:junit4]   2> 2277228 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2277228 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2277228 T4047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2277229 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2277228 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2277332 T4048 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2277334 T4048 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 2277351 T4048 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 2278559 T4048 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2278573 T4048 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2278583 T4048 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2278618 T4048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2278626 T4048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2278633 T4048 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2278636 T4048 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2278636 T4048 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 2278636 T4048 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2278640 T4048 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2278640 T4048 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 2278641 T4048 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 2278641 T4048 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372333334271/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty3/
[junit4:junit4]   2> 2278642 T4048 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@28e04e24
[junit4:junit4]   2> 2278643 T4048 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty3
[junit4:junit4]   2> 2278646 T4048 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty3/index/
[junit4:junit4]   2> 2278649 T4048 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2278650 T4048 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty3/index
[junit4:junit4]   2> 2278654 T4048 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7500d874 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5279f1e0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 2278654 T4048 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 2278661 T4048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2278661 T4048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2278662 T4048 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2278663 T4048 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2278664 T4048 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2278665 T4048 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2278667 T4048 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2278667 T4048 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2278668 T4048 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2278690 T4048 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2278700 T4048 oass.SolrIndexSearcher.<init> Opening Searcher@9a579e1 main
[junit4:junit4]   2> 2278702 T4048 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2278702 T4048 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2278706 T4050 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9a579e1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2278708 T4048 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2278708 T4048 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50616/u/lk collection:collection1 shard:shard1
[junit4:junit4]   2> 2278723 T4048 oasc.ZkController.register We are http://127.0.0.1:50616/u/lk/collection1/ and leader is http://127.0.0.1:50609/u/lk/collection1/
[junit4:junit4]   2> 2278724 T4048 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50616/u/lk
[junit4:junit4]   2> 2278724 T4048 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 2278724 T4048 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C787 name=collection1 org.apache.solr.core.SolrCore@44734242 url=http://127.0.0.1:50616/u/lk/collection1 node=127.0.0.1:50616_u%2Flk C787_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:50616_u%2Flk, base_url=http://127.0.0.1:50616/u/lk}
[junit4:junit4]   2> 2278726 T4051 C787 P50616 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 2278726 T4048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2278726 T4051 C787 P50616 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 2278727 T4051 C787 P50616 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 2278727 T4051 C787 P50616 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2278729 T3972 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2278730 T3972 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2278729 T4051 C787 P50616 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2278730 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2278770 T4004 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 2278798 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2278799 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50616_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50616/u/lk"}
[junit4:junit4]   2> 2279904 T4047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2279905 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2279905 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2279905 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2279914 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2280713 T3972 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 2280723 T3972 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50623
[junit4:junit4]   2> 2280724 T3972 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2280724 T3972 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2280724 T3972 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372333340098
[junit4:junit4]   2> 2280725 T3972 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372333340098/solr.xml
[junit4:junit4]   2> 2280725 T3972 oasc.CoreContainer.<init> New CoreContainer 924512552
[junit4:junit4]   2> 2280726 T3972 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372333340098/'
[junit4:junit4]   2> 2280726 T3972 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372333340098/'
[junit4:junit4]   2> 2280772 T4004 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   2> 2280773 T4004 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node3&state=recovering&nodeName=127.0.0.1:50616_u%252Flk&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4]   2> 2281076 T3972 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 2281076 T3972 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2281077 T3972 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2281077 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2281077 T3972 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2281078 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2281078 T3972 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2281078 T3972 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2281079 T3972 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2281079 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2281099 T3972 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 2281099 T3972 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50602/solr
[junit4:junit4]   2> 2281100 T3972 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2281102 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2281382 T4063 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b7d0ae2 name:ZooKeeperConnection Watcher:127.0.0.1:50602 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2281403 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2281507 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 2281565 T3972 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2281576 T4065 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5cfe3a94 name:ZooKeeperConnection Watcher:127.0.0.1:50602/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2281577 T3972 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2281591 T3972 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 2282609 T3972 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50623_u%2Flk
[junit4:junit4]   2> 2282615 T3972 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50623_u%2Flk
[junit4:junit4]   2> 2282620 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2282622 T4047 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2282622 T4047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2282626 T4001 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2282631 T4065 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2282634 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2282644 T4014 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2282644 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2282644 T4030 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2282645 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2282650 T3994 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 2282652 T4066 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2282653 T4066 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2282656 T4066 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4]   2>  C787_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:50616_u%2Flk, base_url=http://127.0.0.1:50616/u/lk}
[junit4:junit4]   2> 2282774 T4051 C787 P50616 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50609/u/lk/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 2282775 T4051 C787 P50616 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50616/u/lk START replicas=[http://127.0.0.1:50609/u/lk/collection1/] nUpdates=100
[junit4:junit4]   2> 2282776 T4051 C787 P50616 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 2282776 T4051 C787 P50616 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 2282776 T4051 C787 P50616 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 2282777 T4051 C787 P50616 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 2282778 T4051 C787 P50616 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 2282778 T4051 C787 P50616 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50609/u/lk/collection1/. core=collection1
[junit4:junit4]   2> 2282778 T4051 C787 P50616 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C788 name=collection1 org.apache.solr.core.SolrCore@1f757498 url=http://127.0.0.1:50609/u/lk/collection1 node=127.0.0.1:50609_u%2Flk C788_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50609_u%2Flk, base_url=http://127.0.0.1:50609/u/lk, leader=true}
[junit4:junit4]   2> 2282796 T4004 C788 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 2282804 T4005 C788 P50609 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2282804 T4005 C788 P50609 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2282805 T4005 C788 P50609 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2282805 T4005 C788 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 1
[junit4:junit4]   2> 2282807 T4051 C787 P50616 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 2282807 T4051 C787 P50616 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 2282810 T4006 C788 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 2282811 T4051 C787 P50616 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 2282812 T4051 C787 P50616 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 2282812 T4051 C787 P50616 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2282812 T4051 C787 P50616 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2282814 T4051 C787 P50616 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 2283057 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2283058 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50623_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50623/u/lk"}
[junit4:junit4]   2> 2283058 T3995 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 2283059 T3995 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2283067 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50616_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50616/u/lk"}
[junit4:junit4]   2> 2283854 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2283855 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2283856 T4065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2283859 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2283859 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2283860 T4047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2284658 T4066 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4]   2> 2284659 T4066 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372333340098/collection1
[junit4:junit4]   2> 2284659 T4066 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2284661 T4066 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2284661 T4066 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2284665 T4066 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372333340098/collection1/'
[junit4:junit4]   2> 2284667 T4066 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372333340098/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2284667 T4066 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372333340098/collection1/lib/README' to classloader
[junit4:junit4]   2> 2284793 T4066 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2284901 T4066 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2284905 T4066 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 2284916 T4066 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 2286118 T4066 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2286137 T4066 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2286144 T4066 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2286298 T4066 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2286353 T4066 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2286360 T4066 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2286363 T4066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2286938 T4066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 2286940 T4066 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2286972 T4066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2286980 T4066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 2286988 T4066 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 2286991 T4066 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372333340098/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty4/
[junit4:junit4]   2> 2286997 T4066 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@28e04e24
[junit4:junit4]   2> 2287011 T4066 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty4
[junit4:junit4]   2> 2287011 T4066 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty4/index/
[junit4:junit4]   2> 2287012 T4066 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2287012 T4066 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty4/index
[junit4:junit4]   2> 2287369 T4066 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@449fbf0a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c3efd0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 2287371 T4066 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 2287377 T4066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2287377 T4066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2287378 T4066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2287379 T4066 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2287382 T4066 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2287382 T4066 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2287385 T4066 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2287386 T4066 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2287386 T4066 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2287403 T4066 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2287414 T4066 oass.SolrIndexSearcher.<init> Opening Searcher@10ae287a main
[junit4:junit4]   2> 2287416 T4066 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2287416 T4066 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2287425 T4068 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10ae287a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2287431 T4066 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2287431 T4066 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50623/u/lk collection:collection1 shard:shard1
[junit4:junit4]   2> 2287448 T4066 oasc.ZkController.register We are http://127.0.0.1:50623/u/lk/collection1/ and leader is http://127.0.0.1:50609/u/lk/collection1/
[junit4:junit4]   2> 2287448 T4066 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50623/u/lk
[junit4:junit4]   2> 2287449 T4066 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 2287449 T4066 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C789 name=collection1 org.apache.solr.core.SolrCore@a89f7ab url=http://127.0.0.1:50623/u/lk/collection1 node=127.0.0.1:50623_u%2Flk C789_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:50623_u%2Flk, base_url=http://127.0.0.1:50623/u/lk}
[junit4:junit4]   2> 2287451 T4069 C789 P50623 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 2287452 T4069 C789 P50623 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 2287452 T4069 C789 P50623 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 2287452 T4069 C789 P50623 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2287460 T4069 C789 P50623 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2287502 T4066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2287513 T3972 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 2287514 T3972 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2287516 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2287520 T4006 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 2287535 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2287537 T3972 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 30 for each attempt
[junit4:junit4]   2> 2287538 T3972 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30
[junit4:junit4]   2> 2287539 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2288543 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2288937 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2288940 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50623_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50623/u/lk"}
[junit4:junit4]   2> 2288961 T4065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2288962 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2288973 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2288979 T4047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2288976 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2289007 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2289523 T4006 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   2> 2289816 T4006 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node4&state=recovering&nodeName=127.0.0.1:50623_u%252Flk&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2296
[junit4:junit4]   2> 2289550 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2290842 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2>  C789_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:50623_u%2Flk, base_url=http://127.0.0.1:50623/u/lk}
[junit4:junit4]   2> 2291839 T4069 C789 P50623 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50609/u/lk/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 2291842 T4069 C789 P50623 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50623/u/lk START replicas=[http://127.0.0.1:50609/u/lk/collection1/] nUpdates=100
[junit4:junit4]   2> 2291843 T4069 C789 P50623 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 2291843 T4069 C789 P50623 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 2291843 T4069 C789 P50623 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 2291844 T4069 C789 P50623 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 2291844 T4069 C789 P50623 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 2291844 T4069 C789 P50623 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50609/u/lk/collection1/. core=collection1
[junit4:junit4]   2> 2291845 T4069 C789 P50623 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C790 name=collection1 org.apache.solr.core.SolrCore@1f757498 url=http://127.0.0.1:50609/u/lk/collection1 node=127.0.0.1:50609_u%2Flk C790_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50609_u%2Flk, base_url=http://127.0.0.1:50609/u/lk, leader=true}
[junit4:junit4]   2> 2291847 T4006 C790 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 2291850 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2291867 T4008 C790 P50609 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2291868 T4008 C790 P50609 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2291869 T4008 C790 P50609 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2291869 T4008 C790 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 2
[junit4:junit4]   2> 2291871 T4069 C789 P50623 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 2291871 T4069 C789 P50623 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 2291875 T4009 C790 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 2291877 T4069 C789 P50623 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 2291877 T4069 C789 P50623 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 2291878 T4069 C789 P50623 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2291878 T4069 C789 P50623 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2291881 T4069 C789 P50623 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 2292073 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2292075 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50623_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50623/u/lk"}
[junit4:junit4]   2> 2292088 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2292089 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2292090 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2292097 T4065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2292102 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2292106 T4047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2292857 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2292860 T3972 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C791 name=collection1 org.apache.solr.core.SolrCore@310411f8 url=http://127.0.0.1:50605/u/lk/collection1 node=127.0.0.1:50605_u%2Flk C791_STATE=coll:control_collection core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50605_u%2Flk, base_url=http://127.0.0.1:50605/u/lk, leader=true}
[junit4:junit4]   2> 2292879 T3986 C791 P50605 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2292888 T3986 C791 P50605 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5906bda6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@131117ce),segFN=segments_1,generation=1}
[junit4:junit4]   2> 2292890 T3986 C791 P50605 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 2292891 T3986 C791 P50605 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2292892 T3986 C791 P50605 oass.SolrIndexSearcher.<init> Opening Searcher@3b061b48 main
[junit4:junit4]   2> 2292892 T3986 C791 P50605 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2292895 T3998 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3b061b48 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 2292897 T3986 C791 P50605 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4]   2> ASYNC  NEW_CORE C792 name=collection1 org.apache.solr.core.SolrCore@44734242 url=http://127.0.0.1:50616/u/lk/collection1 node=127.0.0.1:50616_u%2Flk C792_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50616_u%2Flk, base_url=http://127.0.0.1:50616/u/lk}
[junit4:junit4]   2> 2292932 T4041 C792 P50616 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:50609/u/lk/collection1/, StdNode: http://127.0.0.1:50612/u/lk/collection1/, StdNode: http://127.0.0.1:50616/u/lk/collection1/, StdNode: http://127.0.0.1:50623/u/lk/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 2292955 T4042 C792 P50616 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2292956 T4007 C790 P50609 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2292956 T4007 C790 P50609 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2292958 T4007 C790 P50609 oass.SolrIndexSearcher.<init> Opening Searcher@2b71797d main
[junit4:junit4]   2> 2292959 T4007 C790 P50609 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2292964 T4016 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b71797d main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 2292965 T4007 C790 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4]   2>  C789_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50623_u%2Flk, base_url=http://127.0.0.1:50623/u/lk}
[junit4:junit4]   2> 2292980 T4060 C789 P50623 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2292981 T4042 C792 P50616 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7500d874 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5279f1e0),segFN=segments_1,generation=1}
[junit4:junit4]   2> 2292984 T4060 C789 P50623 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@449fbf0a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c3efd0),segFN=segments_1,generation=1}
[junit4:junit4]   2> ASYNC  NEW_CORE C793 name=collection1 org.apache.solr.core.SolrCore@775b3e1d url=http://127.0.0.1:50612/u/lk/collection1 node=127.0.0.1:50612_u%2Flk C793_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50612_u%2Flk, base_url=http://127.0.0.1:50612/u/lk}
[junit4:junit4]   2> 2292985 T4024 C793 P50612 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2292988 T4042 C792 P50616 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 2292988 T4042 C792 P50616 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2292993 T4042 C792 P50616 oass.SolrIndexSearcher.<init> Opening Searcher@3cd97ef4 main
[junit4:junit4]   2> 2292988 T4024 C793 P50612 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2cfd9287 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e3a59d),segFN=segments_1,generation=1}
[junit4:junit4]   2> 2292995 T4042 C792 P50616 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2292994 T4060 C789 P50623 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 2292998 T4060 C789 P50623 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2292997 T4050 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3cd97ef4 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 2292997 T4024 C793 P50612 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 2293000 T4024 C793 P50612 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2292999 T4042 C792 P50616 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 45
[junit4:junit4]   2> 2292999 T4060 C789 P50623 oass.SolrIndexSearcher.<init> Opening Searcher@1d5211d9 main
[junit4:junit4]   2> 2293001 T4060 C789 P50623 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2293000 T4024 C793 P50612 oass.SolrIndexSearcher.<init> Opening Searcher@318f4c3a main
[junit4:junit4]   2> 2293002 T4024 C793 P50612 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2293003 T4068 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d5211d9 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 2293005 T4060 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4]   2> 2293006 T4032 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@318f4c3a main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 2293010 T4024 C793 P50612 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4]   2> 2293012 T4041 C792 P50616 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 80
[junit4:junit4]   2> 2293015 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2293023 T4008 C790 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4]   2> 2293034 T4026 C793 P50612 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4]   2> 2293039 T4038 C792 P50616 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4]   2> 2293044 T4056 C789 P50623 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4]   2> 2295061 T3986 C791 P50605 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438995821524680704)} 0 4
[junit4:junit4]   2> 2295088 T4060 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={update.distrib=FROMLEADER&_version_=-1438995821537263616&update.from=http://127.0.0.1:50609/u/lk/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438995821537263616)} 0 2
[junit4:junit4]   2> 2295099 T4038 C792 P50616 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={update.distrib=FROMLEADER&_version_=-1438995821537263616&update.from=http://127.0.0.1:50609/u/lk/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438995821537263616)} 0 3
[junit4:junit4]   2> 2295110 T4021 C793 P50612 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={update.distrib=FROMLEADER&_version_=-1438995821537263616&update.from=http://127.0.0.1:50609/u/lk/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438995821537263616)} 0 7
[junit4:junit4]   2> 2295113 T4008 C790 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438995821537263616)} 0 43
[junit4:junit4]   2> 2295114 T4024 C793 P50612 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 48
[junit4:junit4]   2> 2295131 T3987 C791 P50605 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={wt=javabin&version=2} {add=[0 (1438995821588643840)]} 0 13
[junit4:junit4]   2> 2295148 T4056 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438995821606469632)]} 0 3
[junit4:junit4]   2> 2295152 T4039 C792 P50616 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438995821606469632)]} 0 2
[junit4:junit4]   2> 2295156 T4022 C793 P50612 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438995821606469632)]} 0 2
[junit4:junit4]   2> 2295158 T4004 C790 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={wt=javabin&version=2} {add=[0 (1438995821606469632)]} 0 22
[junit4:junit4]   2> 2295165 T3988 C791 P50605 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={wt=javabin&version=2} {add=[1 (1438995821635829760)]} 0 1
[junit4:junit4]   2> 2295185 T4023 C793 P50612 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438995821651558400)]} 0 1
[junit4:junit4]   2> 2295185 T4040 C792 P50616 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438995821651558400)]} 0 1
[junit4:junit4]   2> 2295187 T4058 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438995821651558400)]} 0 2
[junit4:junit4]   2> 2295188 T4009 C790 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50623/u/lk/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1438995821651558400)]} 0 12
[junit4:junit4]   2> 2295190 T4057 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={wt=javabin&version=2} {add=[1]} 0 20
[junit4:junit4]   2> 2295197 T3989 C791 P50605 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={wt=javabin&version=2} {add=[2 (1438995821669384192)]} 0 1
[junit4:junit4]   2> 2295201 T4005 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:50612/u/lk/collection1/]
[junit4:junit4]   2> 2295201 T4005 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50612/u/lk/collection1/ against:[http://127.0.0.1:50612/u/lk/collection1/] result:true
[junit4:junit4]   2> 2295202 T4005 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50616/u/lk/collection1/ against:[http://127.0.0.1:50612/u/lk/collection1/] result:false
[junit4:junit4]   2> 2295202 T4005 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50623/u/lk/collection1/ against:[http://127.0.0.1:50612/u/lk/collection1/] result:false
[junit4:junit4]   2> 2295208 T4042 C792 P50616 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50612/u/lk/collection1/&wt=javabin&version=2} {add=[2 (1438995821676724224)]} 0 2
[junit4:junit4]   2> 2295211 T4059 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50612/u/lk/collection1/&wt=javabin&version=2} {add=[2 (1438995821676724224)]} 0 1
[junit4:junit4]   2> 2295212 T4005 C790 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={test.distrib.skip.servers=http://127.0.0.1:50612/u/lk/collection1/&wt=javabin&version=2} {add=[2 (1438995821676724224)]} 0 12
[junit4:junit4]   2> 2295217 T3990 C791 P50605 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={wt=javabin&version=2} {add=[3 (1438995821690355712)]} 0 1
[junit4:junit4]   2> 2295223 T4006 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:50612/u/lk/collection1/]
[junit4:junit4]   2> 2295223 T4006 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50612/u/lk/collection1/ against:[http://127.0.0.1:50612/u/lk/collection1/] result:true
[junit4:junit4]   2> 2295224 T4006 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50616/u/lk/collection1/ against:[http://127.0.0.1:50612/u/lk/collection1/] result:false
[junit4:junit4]   2> 2295224 T4006 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50623/u/lk/collection1/ against:[http://127.0.0.1:50612/u/lk/collection1/] result:false
[junit4:junit4]   2> 2295229 T4060 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50612/u/lk/collection1/&wt=javabin&version=2} {add=[3 (1438995821699792896)]} 0 1
[junit4:junit4]   2> 2295232 T4043 C792 P50616 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50612/u/lk/collection1/&wt=javabin&version=2} {add=[3 (1438995821699792896)]} 0 1
[junit4:junit4]   2> 2295233 T4006 C790 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50623/u/lk/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:50612/u/lk/collection1/&wt=javabin&version=2} {add=[3 (1438995821699792896)]} 0 10
[junit4:junit4]   2> 2295235 T4061 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={test.distrib.skip.servers=http://127.0.0.1:50612/u/lk/collection1/&test.distrib.skip.servers=http://127.0.0.1:50616/u/lk/collection1/&wt=javabin&version=2} {add=[3]} 0 15
[junit4:junit4]   2> 2295241 T3985 C791 P50605 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2295254 T3985 C791 P50605 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5906bda6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@131117ce),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5906bda6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@131117ce),segFN=segments_2,generation=2}
[junit4:junit4]   2> 2295255 T3985 C791 P50605 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 2295258 T3985 C791 P50605 oass.SolrIndexSearcher.<init> Opening Searcher@6206576 main
[junit4:junit4]   2> 2295258 T3985 C791 P50605 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2295259 T3998 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6206576 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4]   2> 2295260 T3985 C791 P50605 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4]   2> 2295271 T4056 C789 P50623 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:50609/u/lk/collection1/, StdNode: http://127.0.0.1:50612/u/lk/collection1/, StdNode: http://127.0.0.1:50616/u/lk/collection1/, StdNode: http://127.0.0.1:50623/u/lk/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 2295293 T4058 C789 P50623 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2295306 T4007 C790 P50609 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2295313 T4058 C789 P50623 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@449fbf0a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c3efd0),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@449fbf0a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c3efd0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 2295314 T4058 C789 P50623 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 2295319 T4058 C789 P50623 oass.SolrIndexSearcher.<init> Opening Searcher@176943bb main
[junit4:junit4]   2> 2295320 T4058 C789 P50623 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2295322 T4068 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@176943bb main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4]   2> 2295323 T4058 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 31
[junit4:junit4]   2> 2295325 T4026 C793 P50612 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2295341 T4041 C792 P50616 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2295347 T4007 C790 P50609 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b7fe787 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dcc1ab7),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b7fe787 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dcc1ab7),segFN=segments_2,generation=2}
[junit4:junit4]   2> 2295348 T4007 C790 P50609 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 2295350 T4041 C792 P50616 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7500d874 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5279f1e0),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7500d874 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5279f1e0),segFN=segments_2,generation=2}
[junit4:junit4]   2> 2295351 T4041 C792 P50616 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 2295352 T4007 C790 P50609 oass.SolrIndexSearcher.<init> Opening Searcher@7b07efb0 main
[junit4:junit4]   2> 2295353 T4041 C792 P50616 oass.SolrIndexSearcher.<init> Opening Searcher@9df9358 main
[junit4:junit4]   2> 2295354 T4007 C790 P50609 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2295356 T4016 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b07efb0 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4]   2> 2295357 T4026 C793 P50612 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2cfd9287 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e3a59d),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2cfd9287 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e3a59d),segFN=segments_2,generation=2}
[junit4:junit4]   2> 2295358 T4026 C793 P50612 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 2295354 T4041 C792 P50616 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2295357 T4007 C790 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 51
[junit4:junit4]   2> 2295356 T4050 oasc.JmxMonitoredMap.put WARN Failed to register info bean: fieldValueCache javax.management.InstanceAlreadyExistsException: solr/collection1:type=fieldValueCache,id=org.apache.solr.search.FastLRUCache
[junit4:junit4]   2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4]   2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4]   2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4]   2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4]   2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4]   2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4:junit4]   2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4]   2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4]   2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:309)
[junit4:junit4]   2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1844)
[junit4:junit4]   2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
[junit4:junit4]   2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1721)
[junit4:junit4]   2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4]   2>
[junit4:junit4]   2> 2295362 T4050 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9df9358 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4]   2> 2295360 T4026 C793 P50612 oass.SolrIndexSearcher.<init> Opening Searcher@76f59606 main
[junit4:junit4]   2> 2295363 T4041 C792 P50616 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 24
[junit4:junit4]   2> 2295363 T4026 C793 P50612 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2295365 T4032 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@76f59606 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c2)}
[junit4:junit4]   2> 2295367 T4026 C793 P50612 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 42
[junit4:junit4]   2> 2295368 T4056 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 97
[junit4:junit4]   2> 2295369 T3972 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):330
[junit4:junit4]   2> 2295371 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2295373 T3972 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> 2295377 T4008 C790 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2> 2295381 T4021 C793 P50612 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=1
[junit4:junit4]   2> 2295385 T4038 C792 P50616 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4]   2> 2295390 T4057 C789 P50623 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2> 2295392 T3972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2295420 T4039 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4]   2> 2295421 T4039 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2295455 T4009 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4]   2> 2295456 T4009 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50609/u/lk/collection1/
[junit4:junit4]   2> 2295457 T4009 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50609/u/lk START replicas=[http://127.0.0.1:50612/u/lk/collection1/, http://127.0.0.1:50616/u/lk/collection1/, http://127.0.0.1:50623/u/lk/collection1/] nUpdates=100
[junit4:junit4]   2> 2295464 T4024 C793 P50612 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 2295466 T4009 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50609/u/lk  Received 3 versions from 127.0.0.1:50612/u/lk/collection1/
[junit4:junit4]   2> 2295467 T4009 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50609/u/lk  Our versions are newer. ourLowThreshold=1438995821537263616 otherHigh=1438995821651558400
[junit4:junit4]   2> 2295476 T4059 C789 P50623 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 2295479 T4040 C792 P50616 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 2295481 T4009 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50609/u/lk  Received 5 versions from 127.0.0.1:50623/u/lk/collection1/
[junit4:junit4]   2> 2295482 T4009 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50609/u/lk  Our versions are newer. ourLowThreshold=1438995821537263616 otherHigh=1438995821676724224
[junit4:junit4]   2> 2295483 T4009 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50609/u/lk  Received 5 versions from 127.0.0.1:50616/u/lk/collection1/
[junit4:junit4]   2> 2295484 T4009 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50609/u/lk  Our versions are newer. ourLowThreshold=1438995821537263616 otherHigh=1438995821676724224
[junit4:junit4]   2> 2295484 T4009 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50609/u/lk DONE. sync succeeded
[junit4:junit4]   2> 2295485 T4009 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2295485 T4009 oasc.SyncStrategy.syncToMe http://127.0.0.1:50609/u/lk/collection1/: try and ask http://127.0.0.1:50612/u/lk/collection1/ to sync
[junit4:junit4]   2> 2295487 T4009 oasc.SyncStrategy.syncToMe http://127.0.0.1:50609/u/lk/collection1/: try and ask http://127.0.0.1:50616/u/lk/collection1/ to sync
[junit4:junit4]   2> 2295489 T4009 oasc.SyncStrategy.syncToMe http://127.0.0.1:50609/u/lk/collection1/: try and ask http://127.0.0.1:50623/u/lk/collection1/ to sync
[junit4:junit4]   2> 2295503 T4061 C789 P50623 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50623/u/lk START replicas=[http://127.0.0.1:50609/u/lk/collection1/] nUpdates=100
[junit4:junit4]   2> 2295503 T4023 C793 P50612 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk START replicas=[http://127.0.0.1:50609/u/lk/collection1/] nUpdates=100
[junit4:junit4]   2> 2295512 T4043 C792 P50616 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50616/u/lk START replicas=[http://127.0.0.1:50609/u/lk/collection1/] nUpdates=100
[junit4:junit4]   2> 2295521 T4005 C790 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 2295522 T4005 C790 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 2295530 T4008 C790 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 2295532 T4043 C792 P50616 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50616/u/lk  Received 5 versions from 127.0.0.1:50609/u/lk/collection1/
[junit4:junit4]   2> 2295533 T4043 C792 P50616 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50616/u/lk  Our versions are newer. ourLowThreshold=1438995821537263616 otherHigh=1438995821676724224
[junit4:junit4]   2> 2295534 T4043 C792 P50616 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50616/u/lk DONE. sync succeeded
[junit4:junit4]   2> 2295534 T4043 C792 P50616 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={sync=http://127.0.0.1:50609/u/lk/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=22
[junit4:junit4]   2> 2295536 T4023 C793 P50612 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk  Received 5 versions from 127.0.0.1:50609/u/lk/collection1/
[junit4:junit4]   2> 2295536 T4023 C793 P50612 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk Requesting updates from 127.0.0.1:50609/u/lk/collection1/n=2 versions=[1438995821699792896, 1438995821676724224]
[junit4:junit4]   2> 2295538 T4061 C789 P50623 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50623/u/lk  Received 5 versions from 127.0.0.1:50609/u/lk/collection1/
[junit4:junit4]   2> 2295539 T4061 C789 P50623 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50623/u/lk  Our versions are newer. ourLowThreshold=1438995821537263616 otherHigh=1438995821676724224
[junit4:junit4]   2> 2295540 T4061 C789 P50623 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50623/u/lk DONE. sync succeeded
[junit4:junit4]   2> 2295540 T4061 C789 P50623 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={sync=http://127.0.0.1:50609/u/lk/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=38
[junit4:junit4]   2> 2295544 T4004 C790 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={distrib=false&getUpdates=1438995821699792896,1438995821676724224&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 2295553 T4023 C793 P50612 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1438995821676724224), 3 (1438995821699792896)]} 0 6
[junit4:junit4]   2> 2295554 T4023 C793 P50612 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk DONE. sync succeeded
[junit4:junit4]   2> 2295555 T4023 C793 P50612 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={sync=http://127.0.0.1:50609/u/lk/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=53
[junit4:junit4]   2> 2295557 T4009 oasc.SyncStrategy.syncToMe http://127.0.0.1:50609/u/lk/collection1/:  sync completed with http://127.0.0.1:50612/u/lk/collection1/
[junit4:junit4]   2> 2295558 T4009 oasc.SyncStrategy.syncToMe http://127.0.0.1:50609/u/lk/collection1/:  sync completed with http://127.0.0.1:50616/u/lk/collection1/
[junit4:junit4]   2> 2295569 T4009 oasc.SyncStrategy.syncToMe http://127.0.0.1:50609/u/lk/collection1/:  sync completed with http://127.0.0.1:50623/u/lk/collection1/
[junit4:junit4]   2> 2295570 T4009 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=116
[junit4:junit4]   2> 2295572 T4039 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2} status=0 QTime=152
[junit4:junit4]   2> 2295574 T3972 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 2295575 T3972 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 2295592 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2295594 T3972 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> 2295598 T3986 C791 P50605 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2295600 T3986 C791 P50605 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2295601 T3986 C791 P50605 oass.SolrIndexSearcher.<init> Opening Searcher@2b2f67a3 main
[junit4:junit4]   2> 2295602 T3986 C791 P50605 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2295604 T3998 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b2f67a3 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4]   2> 2295605 T3986 C791 P50605 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4]   2> 2295610 T4025 C793 P50612 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:50609/u/lk/collection1/, StdNode: http://127.0.0.1:50612/u/lk/collection1/, StdNode: http://127.0.0.1:50616/u/lk/collection1/, StdNode: http://127.0.0.1:50623/u/lk/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 2295614 T4005 C790 P50609 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2295625 T4005 C790 P50609 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2295629 T4005 C790 P50609 oass.SolrIndexSearcher.<init> Opening Searcher@34be827b main
[junit4:junit4]   2> 2295630 T4005 C790 P50609 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2295640 T4016 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@34be827b main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4]   2> 2295641 T4041 C792 P50616 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2295642 T4005 C790 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 28
[junit4:junit4]   2> 2295645 T4058 C789 P50623 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2295646 T4058 C789 P50623 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2295643 T4041 C792 P50616 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 2295647 T4058 C789 P50623 oass.SolrIndexSearcher.<init> Opening Searcher@357129a8 main
[junit4:junit4]   2> 2295646 T4026 C793 P50612 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 2295650 T4068 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@357129a8 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4]   2> 2295648 T4058 C789 P50623 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2295652 T4058 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4]   2> 2295647 T4041 C792 P50616 oass.SolrIndexSearcher.<init> Opening Searcher@4c6fde2a main
[junit4:junit4]   2> 2295654 T4041 C792 P50616 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2295656 T4050 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c6fde2a main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c4)}
[junit4:junit4]   2> 2295658 T4041 C792 P50616 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 17
[junit4:junit4]   2> 2295661 T4026 C793 P50612 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2cfd9287 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e3a59d),segFN=segments_2,generation=2}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2cfd9287 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e3a59d),segFN=segments_3,generation=3}
[junit4:junit4]   2> 2295661 T4026 C793 P50612 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 2295663 T4026 C793 P50612 oass.SolrIndexSearcher.<init> Opening Searcher@2712e0a1 main
[junit4:junit4]   2> 2295664 T4026 C793 P50612 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 2295666 T4032 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2712e0a1 main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):c2 _1(5.0):c2)}
[junit4:junit4]   2> 2295667 T4026 C793 P50612 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4]   2> 2295668 T4025 C793 P50612 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 58
[junit4:junit4]   2> 2295671 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2295677 T4006 C790 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2> 2295681 T4021 C793 P50612 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4]   2> 2295686 T4038 C792 P50616 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2> 2295690 T4056 C789 P50623 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4]   2> 2297694 T3972 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> check const of shard1
[junit4:junit4]   2> client0
[junit4:junit4]   2> PROPS:core_node1:{"state":"active","core":"collection1","node_name":"127.0.0.1:50609_u%2Flk","base_url":"http://127.0.0.1:50609/u/lk","leader":"true"}
[junit4:junit4]   2> 2297700 T4006 C790 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2>
[junit4:junit4]   2> client1
[junit4:junit4]   2> PROPS:core_node2:{"state":"active","core":"collection1","node_name":"127.0.0.1:50612_u%2Flk","base_url":"http://127.0.0.1:50612/u/lk"}
[junit4:junit4]   2> 2297706 T4025 C793 P50612 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2>
[junit4:junit4]   2> client2
[junit4:junit4]   2> PROPS:core_node3:{"state":"active","core":"collection1","node_name":"127.0.0.1:50616_u%2Flk","base_url":"http://127.0.0.1:50616/u/lk"}
[junit4:junit4]   2> 2297712 T4038 C792 P50616 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2>
[junit4:junit4]   2> client3
[junit4:junit4]   2> PROPS:core_node4:{"state":"active","core":"collection1","node_name":"127.0.0.1:50623_u%2Flk","base_url":"http://127.0.0.1:50623/u/lk"}
[junit4:junit4]   2> 2297718 T4056 C789 P50623 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2>
[junit4:junit4]   2> 2297724 T4007 C790 P50609 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/select params={q=*:*&wt=javabin&version=2} hits=4 status=0 QTime=1
[junit4:junit4]   2> 2297758 T3986 C791 P50605 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={wt=javabin&version=2} {add=[4 (1438995824339058688)]} 0 17
[junit4:junit4]   2> 2297766 T4008 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:50616/u/lk/collection1/]
[junit4:junit4]   2> 2297767 T4008 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50612/u/lk/collection1/ against:[http://127.0.0.1:50616/u/lk/collection1/] result:false
[junit4:junit4]   2> 2297768 T4008 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50616/u/lk/collection1/ against:[http://127.0.0.1:50616/u/lk/collection1/] result:true
[junit4:junit4]   2> 2297769 T4008 C790 P50609 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50623/u/lk/collection1/ against:[http://127.0.0.1:50616/u/lk/collection1/] result:false
[junit4:junit4]   2> 2297785 T4024 C793 P50612 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50616/u/lk/collection1/&wt=javabin&version=2} {add=[4 (1438995824368418816)]} 0 6
[junit4:junit4]   2> 2297793 T4057 C789 P50623 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50609/u/lk/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50616/u/lk/collection1/&wt=javabin&version=2} {add=[4 (1438995824368418816)]} 0 7
[junit4:junit4]   2> 2297801 T4008 C790 P50609 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={distrib.from=http://127.0.0.1:50612/u/lk/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:50616/u/lk/collection1/&wt=javabin&version=2} {add=[4 (1438995824368418816)]} 0 35
[junit4:junit4]   2> 2297805 T4021 C793 P50612 oasup.LogUpdateProcessor.finish [collection1] webapp=/u/lk path=/update params={test.distrib.skip.servers=http://127.0.0.1:50616/u/lk/collection1/&wt=javabin&version=2} {add=[4]} 0 43
[junit4:junit4]   2> 2297806 T3972 oasc.ChaosMonkey.monkeyLog monkey: kill shard! 50609
[junit4:junit4]   2> 2297823 T3972 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=937461520
[junit4:junit4]   2> 2298151 T3995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2298155 T3995 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:50609_u%2Flk",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50609/u/lk"}
[junit4:junit4]   2> 2298155 T3995 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4:junit4]   2> 2298169 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2298170 T4047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2298171 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2298169 T4065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2298170 T4030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2298170 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2299830 T3972 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2299831 T3972 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2299841 T3972 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1f757498
[junit4:junit4]   2> 2299852 T3972 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 2299854 T3972 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 2299855 T3972 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 2299855 T3972 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2>  C790_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:50609_u%2Flk, base_url=http://127.0.0.1:50609/u/lk, leader=true}
[junit4:junit4]   2> 2299883 T3972 C790 P50609 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b7fe787 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dcc1ab7),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b7fe787 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dcc1ab7),segFN=segments_2,generation=2}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b7fe787 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dcc1ab7),segFN=segments_3,generation=3}
[junit4:junit4]   2> 2299885 T3972 C790 P50609 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 2299899 T3972 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 2299901 T3972 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4]   2> 2299902 T3972 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty1/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty1/index;done=false>>]
[junit4:junit4]   2> 2299903 T3972 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty1/index
[junit4:junit4]   2> 2299904 T3972 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty1 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty1;done=false>>]
[junit4:junit4]   2> 2299905 T3972 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.SyncSliceTest-1372333316964/jetty1
[junit4:junit4]   2> 2299915 T4065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2299916 T4001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2299925 T3994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 2299931 T4047 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2299932 T4047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 2299935 T4001 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2299938 T4030 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4:junit4]   2> 2299939 T4065 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2299943 T3994 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 2299945 T3972 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/u/lk,null}
[junit4:junit4]   2> 2299958 T4030 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4]   2> 2299959 T4030 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4]   2> 2299959 T4030 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2299960 T4030 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50612/u/lk/collection1/
[junit4:junit4]   2> 2299960 T4030 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk START replicas=[http://127.0.0.1:50609/u/lk/collection1/, http://127.0.0.1:50616/u/lk/collection1/, http://127.0.0.1:50623/u/lk/collection1/] nUpdates=100
[junit4:junit4]   2> 2299969 T4042 C792 P50616 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 2299969 T4057 C789 P50623 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 2299973 T4030 oasu.PeerSync.handleResponse WARN PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk  couldn't connect to http://127.0.0.1:50609/u/lk/collection1/, counting as success
[junit4:junit4]   2> 2299974 T4030 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk  Received 5 versions from 127.0.0.1:50616/u/lk/collection1/
[junit4:junit4]   2> 2299975 T4030 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk  Our versions are newer. ourLowThreshold=1438995821606469632 otherHigh=1438995821676724224
[junit4:junit4]   2> 2299978 T4030 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk  Received 6 versions from 127.0.0.1:50623/u/lk/collection1/
[junit4:junit4]   2> 2299980 T4030 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk  Our versions are newer. ourLowThreshold=1438995821606469632 otherHigh=1438995821699792896
[junit4:junit4]   2> 2299981 T4030 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50612/u/lk DONE. sync succeeded
[junit4:junit4]   2> 2299984 T4030 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2299985 T4030 oasc.SyncStrategy.syncToMe http://127.0.0.1:50612/u/lk/collection1/: try and ask http://127.0.0.1:50609/u/lk/collection1/ to sync
[junit4:junit4]   2> 2299986 T4030 oasc.SyncStrategy.syncToMe http://127.0.0.1:50612/u/lk/collection1/: try and ask http://127.0.0.1:50616/u/lk/collection1/ to sync
[junit4:junit4]   2> 2299988 T4030 oasc.SyncStrategy.syncToMe http://127.0.0.1:50612/u/lk/collection1/: try and ask http://127.0.0.1:50623/u/lk/collection1/ to sync
[junit4:junit4]   2> 2299989 T4030 oasc.SolrException.log ERROR Sync request error: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:50609/u/lk/collection1
[junit4:junit4]   2> 2299990 T4030 oasc.SyncStrategy.syncToMe http://127.0.0.1:50612/u/lk/collection1/: Sync failed - asking replica (http://127.0.0.1:50609/u/lk/collection1/) to recover.
[junit4:junit4]   2> 2299991 T4040 C792 P50616 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50616/u/lk START replicas=[http://127.0.0.1:50612/u/lk/collection1/] nUpdates=100
[junit4:junit4]   2> 2299993 T4059 C789 P50623 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50623/u/lk START replicas=[http://127.0.0.1:50612/u/lk/collection1/] nUpdates=100
[junit4:junit4]   2> 2299994 T4100 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2300000 T4021 C793 P50612 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 2300004 T4040 C792 P50616 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50616/u/lk  Received 6 versions from 127.0.0.1:50612/u/lk/collection1/
[junit4:junit4]   2> 2300005 T4040 C792 P50616 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:50616/u/lk Requesting updates from 127.0.0.1:50612/u/lk/collection1/n=1 versions=[1438995824368418816]
[junit4:junit4]   2> 2300010 T4022 C793 P50612 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={distrib=false&getUpdates=1438995824368418816&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 2300013 T4022 C793 P50612 oasc.SolrCore.execute [collection1] webapp=/u/lk path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 2300015 T4059 C789 P50623 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50623/u/lk  Received 6 versions from 127.0.0.1:50612/u/lk/collection1/
[junit4:junit4]   2> 2300016 T4059 C789 P50623 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50623/u/lk  Our versions are newer. ourLowThreshold=1438995821606469632 otherHigh=1438995821699792896
[junit4:junit4]   2> 2300017 T4059 C789 P50623 oasu.PeerSync.sync P

[...truncated too long message...]

junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>   /solr/collections (2)
[junit4:junit4]   1>    /solr/collections/collection1 (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/collection1/shards (0)
[junit4:junit4]   1>     /solr/collections/collection1/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/collection1/leader_elect/shard1/election (3)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89937236261339150-core_node1-n_0000000004 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89937236261339146-core_node3-n_0000000005 (0)
[junit4:junit4]   1>        /solr/collections/collection1/leader_elect/shard1/election/89937236261339148-core_node4-n_0000000003 (0)
[junit4:junit4]   1>     /solr/collections/collection1/leaders (1)
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:50623_u%2Flk",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:50623/u/lk"}
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/shard1/election/89937236261339139-core_node1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:50605_u%2Flk",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:50605/u/lk"}
[junit4:junit4]   1>   /solr/overseer_elect (2)
[junit4:junit4]   1>    /solr/overseer_elect/election (4)
[junit4:junit4]   1>     /solr/overseer_elect/election/89937236261339139-127.0.0.1:50605_u%2Flk-n_0000000000 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89937236261339148-127.0.0.1:50623_u%2Flk-n_0000000004 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89937236261339150-127.0.0.1:50609_u%2Flk-n_0000000005 (0)
[junit4:junit4]   1>     /solr/overseer_elect/election/89937236261339146-127.0.0.1:50616_u%2Flk-n_0000000003 (0)
[junit4:junit4]   1>    /solr/overseer_elect/leader (0)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"id":"89937236261339139-127.0.0.1:50605_u%2Flk-n_0000000000"}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=D274AC0DBA3A6188 -Dtests.slow=true -Dtests.locale=es_CO -Dtests.timezone=Etc/GMT-5 -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  126s | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:50609/u/lk/collection1lastClient and got 267 from http://127.0.0.1:50616/u/lk/collection1
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([D274AC0DBA3A6188:53922215CD6501B4]:0)
[junit4:junit4]    > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1045)
[junit4:junit4]    > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:237)
[junit4:junit4]    > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4]    > at java.lang.Thread.run(Thread.java:724)
[junit4:junit4]   2> 2381290 T3972 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 125692 T3971 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> 2382031 T4065 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 2382031 T4065 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=es_CO, timezone=Etc/GMT-5
[junit4:junit4]   2> NOTE: Mac OS X 10.8.4 x86_64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=2,threads=1,free=18485960,total=393936896
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SolrTestCaseJ4Test, TestFuzzyAnalyzedSuggestions, TestElisionMultitermQuery, QueryElevationComponentTest, TestStressRecovery, TestCSVResponseWriter, TestAddFieldRealTimeGet, PeerSyncTest, PreAnalyzedUpdateProcessorTest, URLClassifyProcessorTest, TestValueSourceCache, TestCharFilters, EchoParamsTest, TestSolr4Spatial, TestArbitraryIndexDir, CacheHeaderTest, ShardSplitTest, RegexBoostProcessorTest, TestCoreDiscovery, SpellPossibilityIteratorTest, TestMultiCoreConfBootstrap, FileBasedSpellCheckerTest, RAMDirectoryFactoryTest, CoreContainerCoreInitFailuresTest, SliceStateUpdateTest, TestJoin, TestIBSimilarityFactory, DirectUpdateHandlerOptimizeTest, TestSuggestSpellingConverter, TestManagedSchemaFieldResource, TestStressLucene, TestRandomDVFaceting, SuggesterFSTTest, TestUniqueKeyFieldResource, TestSolrCoreProperties, TestFastOutputStream, DirectSolrConnectionTest, TestDynamicFieldResource, TestFieldResource, PluginInfoTest, HighlighterConfigTest, StatsComponentTest, ClusterStateUpdateTest, TestReversedWildcardFilterFactory, BlockDirectoryTest, FieldMutatingUpdateProcessorTest, TestExtendedDismaxParser, OpenCloseCoreStressTest, DirectSolrSpellCheckerTest, OverseerCollectionProcessorTest, TestQueryUtils, TestGroupingSearch, TestRTGBase, TestSchemaVersionResource, SystemInfoHandlerTest, HighlighterTest, TestSearchPerf, TestZkChroot, LoggingHandlerTest, TermVectorComponentTest, UniqFieldsUpdateProcessorFactoryTest, TestLuceneMatchVersion, TestSolrDeletionPolicy2, NotRequiredUniqueKeyTest, SampleTest, TestCloudManagedSchema, TestRangeQuery, ZkControllerTest, TestSolrXml, TestDynamicFieldCollectionResource, DocValuesTest, HdfsSyncSliceTest, TestPostingsSolrHighlighter, TestQueryTypes, TestSolrJ, FieldAnalysisRequestHandlerTest, TestComponentsName, NoCacheHeaderTest, DateMathParserTest, TestSystemIdResolver, TestWordDelimiterFilterFactory, TestSerializedLuceneMatchVersion, TestFunctionQuery, CachingDirectoryFactoryTest, TestOmitPositions, TestPseudoReturnFields, DocValuesMultiTest, TestTrie, AlternateDirectoryTest, XsltUpdateRequestHandlerTest, TestManagedSchema, UpdateRequestProcessorFactoryTest, CollectionsAPIDistributedZkTest, SpellCheckComponentTest, TermVectorComponentDistributedTest, TestRandomFaceting, SliceStateTest, BadCopyFieldTest, SolrPluginUtilsTest, JsonLoaderTest, IndexBasedSpellCheckerTest, ChaosMonkeySafeLeaderTest, TestLazyCores, TestQuerySenderListener, SpellingQueryConverterTest, DistributedSpellCheckComponentTest, TestFaceting, MultiTermTest, FastVectorHighlighterTest, ReturnFieldsTest, SuggesterWFSTTest, TestBinaryResponseWriter, ParsingFieldUpdateProcessorsTest, MinimalSchemaTest, DistributedQueryElevationComponentTest, DocumentBuilderTest, TestWriterPerf, TestReload, ResourceLoaderTest, TestDocumentBuilder, SpellCheckCollatorTest, PrimitiveFieldTypeTest, TestSolrQueryParser, DOMUtilTest, LeaderElectionIntegrationTest, TestStressVersions, TestPhraseSuggestions, TestPerFieldSimilarity, TestFieldTypeCollectionResource, ZkCLITest, QueryEqualityTest, TestSolrXMLSerializer, DocumentAnalysisRequestHandlerTest, TestCopyFieldCollectionResource, AnalysisAfterCoreReloadTest, DirectUpdateHandlerTest, UUIDFieldTest, TestFieldTypeResource, IndexReaderFactoryTest, TestConfig, BasicZkTest, SoftAutoCommitTest, TestPartialUpdateDeduplication, RequestHandlersTest, QueryParsingTest, TestSolrXmlPersistence, FullSolrCloudDistribCmdsTest, BasicDistributedZkTest, BasicDistributedZk2Test, UnloadDistributedZkTest, SyncSliceTest]
[junit4:junit4] Completed in 126.54s, 1 test, 1 failure <<< FAILURES!

[...truncated 486 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:386: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:366: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:190: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:443: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1243: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:887: There were test failures: 312 suites, 1315 tests, 1 failure, 26 ignored (13 assumptions)

Total time: 100 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 602 - Still Failing!

Policeman Jenkins Server-2
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/602/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

4 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testShardAssignmentBigger

Error Message:
Unexpected KeeperException!org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes/node28

Stack Trace:
java.lang.AssertionError: Unexpected KeeperException!org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes/node28
        at __randomizedtesting.SeedInfo.seed([FAC02FE89E78D78B:692ED193741128E8]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.OverseerTest$MockZKController.deleteNode(OverseerTest.java:91)
        at org.apache.solr.cloud.OverseerTest$MockZKController.close(OverseerTest.java:98)
        at org.apache.solr.cloud.OverseerTest.testShardAssignmentBigger(OverseerTest.java:383)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at java.lang.Thread.run(Thread.java:724)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest

Error Message:
ERROR: SolrZkClient opens=140 closes=78

Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=140 closes=78
        at __randomizedtesting.SeedInfo.seed([FAC02FE89E78D78B]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:272)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:105)
        at sun.reflect.GeneratedMethodAccessor37.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at java.lang.Thread.run(Thread.java:724)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest

Error Message:
128 threads leaked from SUITE scope at org.apache.solr.cloud.OverseerTest:     1) Thread[id=1346, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)    2) Thread[id=1352, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)    3) Thread[id=1350, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)    4) Thread[id=1283, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)    5) Thread[id=1359, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)    6) Thread[id=1324, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)    7) Thread[id=999, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120)    8) Thread[id=1393, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)    9) Thread[id=1333, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   10) Thread[id=1394, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   11) Thread[id=1286, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   12) Thread[id=1299, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   13) Thread[id=1396, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   14) Thread[id=1313, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   15) Thread[id=1314, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   16) Thread[id=1395, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   17) Thread[id=1317, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   18) Thread[id=1288, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   19) Thread[id=1386, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   20) Thread[id=1384, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   21) Thread[id=1281, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   22) Thread[id=1320, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   23) Thread[id=1349, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   24) Thread[id=1373, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   25) Thread[id=1403, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   26) Thread[id=1285, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   27) Thread[id=1341, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   28) Thread[id=1378, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   29) Thread[id=1305, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   30) Thread[id=1354, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   31) Thread[id=1295, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   32) Thread[id=1370, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   33) Thread[id=1293, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   34) Thread[id=1372, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   35) Thread[id=1344, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   36) Thread[id=996, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178)         at java.lang.Thread.run(Thread.java:724)   37) Thread[id=1339, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   38) Thread[id=1310, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   39) Thread[id=1400, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   40) Thread[id=1328, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   41) Thread[id=1369, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   42) Thread[id=1351, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   43) Thread[id=1336, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   44) Thread[id=1296, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   45) Thread[id=1383, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   46) Thread[id=1390, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   47) Thread[id=1337, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   48) Thread[id=1343, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   49) Thread[id=1292, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   50) Thread[id=1397, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   51) Thread[id=1389, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   52) Thread[id=1367, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   53) Thread[id=1315, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   54) Thread[id=1388, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   55) Thread[id=1360, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   56) Thread[id=1338, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   57) Thread[id=1307, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   58) Thread[id=1355, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   59) Thread[id=1368, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   60) Thread[id=1391, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   61) Thread[id=1348, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   62) Thread[id=1330, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   63) Thread[id=1280, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   64) Thread[id=997, name=SessionTracker, state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Object.wait(Native Method)         at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146)   65) Thread[id=1322, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   66) Thread[id=1316, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   67) Thread[id=1308, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   68) Thread[id=1301, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   69) Thread[id=1306, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   70) Thread[id=1311, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   71) Thread[id=1309, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   72) Thread[id=1392, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   73) Thread[id=1401, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   74) Thread[id=1340, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   75) Thread[id=1358, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   76) Thread[id=1282, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   77) Thread[id=1374, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   78) Thread[id=1319, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   79) Thread[id=1356, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   80) Thread[id=1329, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   81) Thread[id=1375, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   82) Thread[id=1290, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   83) Thread[id=1402, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   84) Thread[id=1366, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   85) Thread[id=1364, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   86) Thread[id=1398, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   87) Thread[id=1377, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   88) Thread[id=1342, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   89) Thread[id=1331, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   90) Thread[id=1363, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   91) Thread[id=1294, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   92) Thread[id=1361, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   93) Thread[id=1345, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   94) Thread[id=1312, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   95) Thread[id=1376, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   96) Thread[id=1300, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   97) Thread[id=1334, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   98) Thread[id=995, name=Thread-420, state=WAITING, group=TGRP-OverseerTest]         at java.lang.Object.wait(Native Method)         at java.lang.Thread.join(Thread.java:1260)         at java.lang.Thread.join(Thread.java:1334)         at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:302)         at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:107)         at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:221)   99) Thread[id=1332, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   100) Thread[id=1347, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   101) Thread[id=1385, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   102) Thread[id=1323, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   103) Thread[id=1326, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   104) Thread[id=1382, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   105) Thread[id=1379, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   106) Thread[id=1387, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   107) Thread[id=1353, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   108) Thread[id=1284, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   109) Thread[id=1325, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   110) Thread[id=1362, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   111) Thread[id=1381, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   112) Thread[id=1399, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   113) Thread[id=1298, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   114) Thread[id=1302, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   115) Thread[id=1318, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   116) Thread[id=1380, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   117) Thread[id=1357, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   118) Thread[id=1287, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   119) Thread[id=1327, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   120) Thread[id=1335, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   121) Thread[id=1321, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   122) Thread[id=1371, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   123) Thread[id=1303, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   124) Thread[id=1297, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   125) Thread[id=1365, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   126) Thread[id=1304, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)   127) Thread[id=1289, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)   128) Thread[id=1291, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 128 threads leaked from SUITE scope at org.apache.solr.cloud.OverseerTest:
   1) Thread[id=1346, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   2) Thread[id=1352, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   3) Thread[id=1350, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   4) Thread[id=1283, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
   5) Thread[id=1359, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
   6) Thread[id=1324, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   7) Thread[id=999, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120)
   8) Thread[id=1393, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
   9) Thread[id=1333, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  10) Thread[id=1394, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  11) Thread[id=1286, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  12) Thread[id=1299, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  13) Thread[id=1396, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  14) Thread[id=1313, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  15) Thread[id=1314, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  16) Thread[id=1395, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  17) Thread[id=1317, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  18) Thread[id=1288, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  19) Thread[id=1386, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  20) Thread[id=1384, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  21) Thread[id=1281, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  22) Thread[id=1320, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  23) Thread[id=1349, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  24) Thread[id=1373, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  25) Thread[id=1403, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  26) Thread[id=1285, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  27) Thread[id=1341, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  28) Thread[id=1378, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  29) Thread[id=1305, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  30) Thread[id=1354, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  31) Thread[id=1295, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  32) Thread[id=1370, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  33) Thread[id=1293, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  34) Thread[id=1372, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  35) Thread[id=1344, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  36) Thread[id=996, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178)
        at java.lang.Thread.run(Thread.java:724)
  37) Thread[id=1339, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  38) Thread[id=1310, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  39) Thread[id=1400, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  40) Thread[id=1328, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  41) Thread[id=1369, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  42) Thread[id=1351, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  43) Thread[id=1336, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  44) Thread[id=1296, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  45) Thread[id=1383, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  46) Thread[id=1390, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  47) Thread[id=1337, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  48) Thread[id=1343, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  49) Thread[id=1292, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  50) Thread[id=1397, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  51) Thread[id=1389, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  52) Thread[id=1367, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  53) Thread[id=1315, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  54) Thread[id=1388, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  55) Thread[id=1360, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  56) Thread[id=1338, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  57) Thread[id=1307, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  58) Thread[id=1355, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  59) Thread[id=1368, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  60) Thread[id=1391, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  61) Thread[id=1348, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  62) Thread[id=1330, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  63) Thread[id=1280, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  64) Thread[id=997, name=SessionTracker, state=TIMED_WAITING, group=TGRP-OverseerTest]
        at java.lang.Object.wait(Native Method)
        at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146)
  65) Thread[id=1322, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  66) Thread[id=1316, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  67) Thread[id=1308, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  68) Thread[id=1301, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  69) Thread[id=1306, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  70) Thread[id=1311, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  71) Thread[id=1309, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  72) Thread[id=1392, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  73) Thread[id=1401, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  74) Thread[id=1340, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  75) Thread[id=1358, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  76) Thread[id=1282, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  77) Thread[id=1374, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  78) Thread[id=1319, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  79) Thread[id=1356, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  80) Thread[id=1329, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  81) Thread[id=1375, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  82) Thread[id=1290, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  83) Thread[id=1402, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  84) Thread[id=1366, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  85) Thread[id=1364, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  86) Thread[id=1398, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  87) Thread[id=1377, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  88) Thread[id=1342, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  89) Thread[id=1331, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  90) Thread[id=1363, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  91) Thread[id=1294, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  92) Thread[id=1361, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  93) Thread[id=1345, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  94) Thread[id=1312, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  95) Thread[id=1376, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  96) Thread[id=1300, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  97) Thread[id=1334, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  98) Thread[id=995, name=Thread-420, state=WAITING, group=TGRP-OverseerTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1260)
        at java.lang.Thread.join(Thread.java:1334)
        at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:302)
        at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:107)
        at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:221)
  99) Thread[id=1332, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  100) Thread[id=1347, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  101) Thread[id=1385, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  102) Thread[id=1323, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  103) Thread[id=1326, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  104) Thread[id=1382, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  105) Thread[id=1379, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  106) Thread[id=1387, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  107) Thread[id=1353, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  108) Thread[id=1284, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  109) Thread[id=1325, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  110) Thread[id=1362, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  111) Thread[id=1381, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  112) Thread[id=1399, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  113) Thread[id=1298, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  114) Thread[id=1302, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  115) Thread[id=1318, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  116) Thread[id=1380, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  117) Thread[id=1357, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  118) Thread[id=1287, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  119) Thread[id=1327, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  120) Thread[id=1335, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  121) Thread[id=1321, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  122) Thread[id=1371, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  123) Thread[id=1303, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  124) Thread[id=1297, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  125) Thread[id=1365, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  126) Thread[id=1304, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=RUNNABLE, group=TGRP-OverseerTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
  127) Thread[id=1289, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
  128) Thread[id=1291, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-EventThread, state=WAITING, group=TGRP-OverseerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
        at __randomizedtesting.SeedInfo.seed([FAC02FE89E78D78B]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=1346, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)    2) Thread[id=1352, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)    3) Thread[id=1308, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)    4) Thread[id=1316, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)    5) Thread[id=1350, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)    6) Thread[id=1306, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)    7) Thread[id=1324, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)    8) Thread[id=1392, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)    9) Thread[id=1340, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   10) Thread[id=1282, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   11) Thread[id=1358, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   12) Thread[id=1394, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   13) Thread[id=1374, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   14) Thread[id=1356, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   15) Thread[id=1286, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   16) Thread[id=1396, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   17) Thread[id=1314, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   18) Thread[id=1290, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   19) Thread[id=1288, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   20) Thread[id=1402, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   21) Thread[id=1364, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   22) Thread[id=1366, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   23) Thread[id=1398, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   24) Thread[id=1386, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   25) Thread[id=1342, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   26) Thread[id=1384, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   27) Thread[id=1294, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   28) Thread[id=1320, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   29) Thread[id=1312, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   30) Thread[id=1376, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   31) Thread[id=1300, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   32) Thread[id=1378, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   33) Thread[id=1334, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   34) Thread[id=1354, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   35) Thread[id=1370, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   36) Thread[id=1332, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   37) Thread[id=1372, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   38) Thread[id=1344, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   39) Thread[id=1310, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   40) Thread[id=1326, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   41) Thread[id=1400, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   42) Thread[id=1328, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   43) Thread[id=1336, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   44) Thread[id=1296, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   45) Thread[id=1390, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   46) Thread[id=1382, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   47) Thread[id=1284, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   48) Thread[id=1292, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   49) Thread[id=1362, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   50) Thread[id=1298, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   51) Thread[id=1302, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   52) Thread[id=1318, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)   53) Thread[id=1380, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   54) Thread[id=1360, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)   55)

[...truncated too long message...]

ct(ClientCnxn.java:937)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4]    >   46) Thread[id=1382, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4]    >   47) Thread[id=1284, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4]    >   48) Thread[id=1292, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4]    >   49) Thread[id=1362, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4]    >   50) Thread[id=1298, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4]    >   51) Thread[id=1302, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4]    >   52) Thread[id=1318, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4]    >   53) Thread[id=1380, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4]    >   54) Thread[id=1360, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4]    >   55) Thread[id=1388, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4]    >   56) Thread[id=1338, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4]    >   57) Thread[id=1368, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4]    >   58) Thread[id=1348, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4]    >   59) Thread[id=1330, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4]    >   60) Thread[id=1280, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4]    >   61) Thread[id=1304, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4]    >   62) Thread[id=1322, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[FAC02FE89E78D78B]-SendThread(localhost:49410), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([FAC02FE89E78D78B]:0)
[junit4:junit4] Completed in 137.79s, 8 tests, 2 failures, 2 errors <<< FAILURES!

[...truncated 815 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:386: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:366: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:190: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:443: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1243: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:887: There were test failures: 312 suites, 1315 tests, 3 suite-level errors, 1 failure, 978 ignored (1 assumption)

Total time: 58 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 603 - Still Failing!

Policeman Jenkins Server-2
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/603/
Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseSerialGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.SpellPossibilityIteratorTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.spelling.SpellPossibilityIteratorTest:     1) Thread[id=9160, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:724)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.spelling.SpellPossibilityIteratorTest:
   1) Thread[id=9160, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
        at __randomizedtesting.SeedInfo.seed([D23303562BB7A80E]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.SpellPossibilityIteratorTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=9160, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:724)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=9160, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
        at __randomizedtesting.SeedInfo.seed([D23303562BB7A80E]:0)




Build Log:
[...truncated 9919 lines...]
[junit4:junit4] Suite: org.apache.solr.spelling.SpellPossibilityIteratorTest
[junit4:junit4]   2> 3332754 T9159 oas.SolrTestCaseJ4.setUp ###Starting testOverlappingTokens
[junit4:junit4]   2> 3333163 T9159 oas.SolrTestCaseJ4.tearDown ###Ending testOverlappingTokens
[junit4:junit4]   2> 3333299 T9159 oas.SolrTestCaseJ4.setUp ###Starting testSpellPossibilityIterator
[junit4:junit4]   2> 3333319 T9159 oas.SolrTestCaseJ4.tearDown ###Ending testSpellPossibilityIterator
[junit4:junit4]   2> 3333459 T9159 oas.SolrTestCaseJ4.setUp ###Starting testScalability
[junit4:junit4]   2> 3333613 T9159 oas.SolrTestCaseJ4.tearDown ###Ending testScalability
[junit4:junit4]   2> 3333615 T9159 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 1013 T9158 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4]   2> 21125 T9158 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1 thread leaked from SUITE scope at org.apache.solr.spelling.SpellPossibilityIteratorTest:
[junit4:junit4]   2>   1) Thread[id=9160, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4]   2>        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4]   2>        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4]   2>        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:724)
[junit4:junit4]   2> 21126 T9158 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4:junit4]   2>   1) Thread[id=9160, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4:junit4]   2> 24142 T9158 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4:junit4]   2>   1) Thread[id=9160, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4]   2>        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4]   2>        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4]   2>        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:724)
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=DefaultSimilarity, locale=pl, timezone=America/Argentina/Buenos_Aires
[junit4:junit4]   2> NOTE: Mac OS X 10.8.4 x86_64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=2,threads=1,free=276880160,total=518979584
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestPerFieldSimilarity, SliceStateTest, FastVectorHighlighterTest, MultiTermTest, ExternalFileFieldSortTest, TestFaceting, TestDefaultSimilarityFactory, TestQuerySenderNoQuery, TestLFUCache, FieldAnalysisRequestHandlerTest, TestOmitPositions, PluginInfoTest, TestBinaryResponseWriter, TestHashPartitioner, EchoParamsTest, QueryResultKeyTest, SolrInfoMBeanTest, TestReload, StatelessScriptUpdateProcessorFactoryTest, ShowFileRequestHandlerTest, MoreLikeThisHandlerTest, HighlighterConfigTest, UnloadDistributedZkTest, DirectSolrConnectionTest, RegexBoostProcessorTest, BasicFunctionalityTest, TestIBSimilarityFactory, TestFoldingMultitermQuery, SystemInfoHandlerTest, SolrCoreTest, LukeRequestHandlerTest, HdfsCollectionsAPIDistributedZkTest, PreAnalyzedUpdateProcessorTest, TestLuceneMatchVersion, OpenExchangeRatesOrgProviderTest, TestZkChroot, TestRandomDVFaceting, RAMDirectoryFactoryTest, TestCSVResponseWriter, JsonLoaderTest, TestStressLucene, XmlUpdateRequestHandlerTest, NumericFieldsTest, TestJmxMonitoredMap, CoreContainerCoreInitFailuresTest, TestSurroundQueryParser, TestBadConfig, TestFieldCollectionResource, PolyFieldTest, TestPartialUpdateDeduplication, TestFastOutputStream, ScriptEngineTest, TestDistributedSearch, BlockCacheTest, WordBreakSolrSpellCheckerTest, PingRequestHandlerTest, ResponseLogComponentTest, TestFuzzyAnalyzedSuggestions, TestSolrXMLSerializer, TestSolrCoreProperties, ShardRoutingCustomTest, SliceStateUpdateTest, TestTrie, TestSolrJ, TestSolrDeletionPolicy1, SolrTestCaseJ4Test, TestFieldTypeResource, FileBasedSpellCheckerTest, TestMergePolicyConfig, TestStressReorder, HdfsRecoveryZkTest, RequiredFieldsTest, BlockDirectoryTest, TestRandomFaceting, UniqFieldsUpdateProcessorFactoryTest, TestRecoveryHdfs, LeaderElectionTest, TestRealTimeGet, TestElisionMultitermQuery, TestJmxIntegration, CurrencyFieldOpenExchangeTest, HdfsBasicDistributedZk2Test, AnalysisAfterCoreReloadTest, TestSolrQueryParser, IndexReaderFactoryTest, ChaosMonkeyNothingIsSafeTest, TestIndexSearcher, TestComponentsName, TestQueryUtils, TestFieldTypeCollectionResource, TestCloudManagedSchema, DocValuesMultiTest, TestJoin, TestReversedWildcardFilterFactory, SuggesterTest, TestCharFilters, TestRTGBase, TestPropInjectDefaults, DisMaxRequestHandlerTest, TestReloadAndDeleteDocs, TestLMDirichletSimilarityFactory, FullSolrCloudDistribCmdsTest, DocValuesTest, CircularListTest, TermVectorComponentTest, TestSolrXmlPersistence, SearchHandlerTest, TestSchemaVersionResource, TestMaxScoreQueryParser, TestSchemaSimilarityResource, ClusterStateTest, TestCoreContainer, TestDynamicFieldResource, ResourceLoaderTest, IndexBasedSpellCheckerTest, TestValueSourceCache, TestCoreDiscovery, TestQuerySenderListener, SimplePostToolTest, CollectionsAPIDistributedZkTest, CacheHeaderTest, TestAtomicUpdateErrorCases, SpellingQueryConverterTest, PrimUtilsTest, SignatureUpdateProcessorFactoryTest, TestUpdate, TermVectorComponentDistributedTest, ZkNodePropsTest, TestSolrDeletionPolicy2, CopyFieldTest, PathHierarchyTokenizerFactoryTest, SpellCheckCollatorTest, NotRequiredUniqueKeyTest, TestDFRSimilarityFactory, TestQueryTypes, ShardRoutingTest, AlternateDirectoryTest, ClusterStateUpdateTest, DefaultValueUpdateProcessorTest, TestFunctionQuery, TestSweetSpotSimilarityFactory, DateFieldTest, TestLazyCores, DistanceFunctionTest, BasicDistributedZkTest, CoreAdminHandlerTest, NoCacheHeaderTest, DirectUpdateHandlerTest, CurrencyFieldXmlFileTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, BasicZkTest, RecoveryZkTest, TestReplicationHandler, ZkSolrClientTest, ZkCLITest, AutoCommitTest, TestDistributedGrouping, TestRecovery, DistributedSpellCheckComponentTest, ZkControllerTest, TestMultiCoreConfBootstrap, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, TestRangeQuery, SimpleFacetsTest, TestSolr4Spatial, StatsComponentTest, SpellCheckComponentTest, TestGroupingSearch, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFiltering, OverseerCollectionProcessorTest, HighlighterTest, SoftAutoCommitTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, TestExtendedDismaxParser, SuggesterFSTTest, SolrRequestParserTest, SuggesterTSTTest, SpatialFilterTest, SuggesterWFSTTest, TestCSVLoader, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, QueryEqualityTest, DirectUpdateHandlerOptimizeTest, SortByFunctionTest, TestRemoteStreaming, XsltUpdateRequestHandlerTest, DebugComponentTest, StandardRequestHandlerTest, TestWriterPerf, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, TermsComponentTest, RequestHandlersTest, DocumentBuilderTest, TestIndexingPerformance, TestArbitraryIndexDir, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, SolrPluginUtilsTest, IndexSchemaTest, TestCollationField, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, JSONWriterTest, MBeansHandlerTest, QueryParsingTest, TestAnalyzedSuggestions, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, SOLR749Test, TestPropInject, UpdateParamsTest, TestSolrIndexConfig, SolrIndexConfigTest, BadComponentTest, TestStressRecovery, SampleTest, TestDocSet, TestBinaryField, TestSearchPerf, MinimalSchemaTest, TestConfig, OutputWriterTest, TestPostingsSolrHighlighter, TestPhraseSuggestions, SpellPossibilityIteratorTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SpellPossibilityIteratorTest -Dtests.seed=D23303562BB7A80E -Dtests.slow=true -Dtests.locale=pl -Dtests.timezone=America/Argentina/Buenos_Aires -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR   0.00s | SpellPossibilityIteratorTest (suite) <<<
[junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.spelling.SpellPossibilityIteratorTest:
[junit4:junit4]    >    1) Thread[id=9160, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:724)
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([D23303562BB7A80E]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4:junit4]    >    1) Thread[id=9160, name=IPC Parameter Sending Thread #4, state=TIMED_WAITING, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
[junit4:junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:724)
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([D23303562BB7A80E]:0)
[junit4:junit4] Completed in 24.20s, 3 tests, 2 errors <<< FAILURES!

[...truncated 190 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:386: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:366: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:190: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:443: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1245: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:889: There were test failures: 312 suites, 1316 tests, 2 suite-level errors, 193 ignored (8 assumptions)

Total time: 95 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 604 - Still Failing!

Policeman Jenkins Server-2
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/604/
Java: 64bit/jdk1.7.0 -XX:+UseCompressedOops -XX:+UseG1GC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
shard1 is not consistent.  Got 305 from http://127.0.0.1:50863/x_avr/bb/collection1lastClient and got 248 from http://127.0.0.1:50870/x_avr/bb/collection1

Stack Trace:
java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:50863/x_avr/bb/collection1lastClient and got 248 from http://127.0.0.1:50870/x_avr/bb/collection1
        at __randomizedtesting.SeedInfo.seed([60679E00F3D4D777:E1811018848BB74B]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1045)
        at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:237)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at java.lang.Thread.run(Thread.java:724)




Build Log:
[...truncated 9580 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 1781265 T5474 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /x_avr/bb
[junit4:junit4]   2> 1781312 T5474 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1372414566269
[junit4:junit4]   2> 1781315 T5474 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 1781316 T5475 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 1781417 T5474 oasc.ZkTestServer.run start zk server on port:50856
[junit4:junit4]   2> 1781419 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1781428 T5481 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f88d7f8 name:ZooKeeperConnection Watcher:127.0.0.1:50856 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1781428 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1781429 T5474 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 1781440 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1781444 T5483 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55ebe322 name:ZooKeeperConnection Watcher:127.0.0.1:50856/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1781444 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1781445 T5474 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 1781452 T5474 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 1781459 T5474 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 1781464 T5474 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 1781472 T5474 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 1781473 T5474 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 1781487 T5474 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 1781488 T5474 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 1781499 T5474 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 1781501 T5474 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 1781507 T5474 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 1781508 T5474 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 1781515 T5474 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 1781516 T5474 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 1781522 T5474 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 1781523 T5474 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 1781530 T5474 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 1781531 T5474 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 1781538 T5474 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 1781538 T5474 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 1781545 T5474 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 1781546 T5474 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 1781958 T5474 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 1781981 T5474 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50859
[junit4:junit4]   2> 1781983 T5474 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1781984 T5474 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1781985 T5474 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372414566510
[junit4:junit4]   2> 1781986 T5474 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372414566510/solr.xml
[junit4:junit4]   2> 1781986 T5474 oasc.CoreContainer.<init> New CoreContainer 1713762612
[junit4:junit4]   2> 1781988 T5474 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372414566510/'
[junit4:junit4]   2> 1781989 T5474 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372414566510/'
[junit4:junit4]   2> 1782123 T5474 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1782124 T5474 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1782125 T5474 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1782125 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1782126 T5474 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1782127 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1782128 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1782129 T5474 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1782130 T5474 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1782131 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1782157 T5474 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 1782158 T5474 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50856/solr
[junit4:junit4]   2> 1782159 T5474 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1782161 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1782165 T5494 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@409fce51 name:ZooKeeperConnection Watcher:127.0.0.1:50856 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1782166 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1782170 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1782186 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1782191 T5496 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16212d95 name:ZooKeeperConnection Watcher:127.0.0.1:50856/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1782191 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1782195 T5474 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 1782204 T5474 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 1782213 T5474 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 1782217 T5474 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50859_x_avr%2Fbb
[junit4:junit4]   2> 1782220 T5474 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50859_x_avr%2Fbb
[junit4:junit4]   2> 1782227 T5474 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 1782239 T5474 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 1782244 T5474 oasc.Overseer.start Overseer (id=89942561015595011-127.0.0.1:50859_x_avr%2Fbb-n_0000000000) starting
[junit4:junit4]   2> 1782252 T5474 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 1782262 T5498 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 1782263 T5474 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 1782268 T5474 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 1782272 T5474 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 1782279 T5497 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 1782286 T5499 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1782286 T5499 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1782289 T5499 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4]   2> 1783794 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1783795 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50859_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50859/x_avr/bb"}
[junit4:junit4]   2> 1783796 T5497 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 1783796 T5497 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 1783804 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 1784292 T5499 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4]   2> 1784292 T5499 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372414566510/collection1
[junit4:junit4]   2> 1784292 T5499 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 1784294 T5499 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1784295 T5499 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 1784298 T5499 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372414566510/collection1/'
[junit4:junit4]   2> 1784300 T5499 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372414566510/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1784301 T5499 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1372414566510/collection1/lib/README' to classloader
[junit4:junit4]   2> 1784367 T5499 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1784443 T5499 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1784447 T5499 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1784453 T5499 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 1785299 T5499 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1785313 T5499 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1785318 T5499 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1785349 T5499 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1785356 T5499 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1785363 T5499 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1785371 T5499 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1785371 T5499 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1785371 T5499 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1785374 T5499 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1785374 T5499 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1785375 T5499 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1785375 T5499 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1372414566510/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372414566268/control/data/
[junit4:junit4]   2> 1785375 T5499 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a04648b
[junit4:junit4]   2> 1785377 T5499 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372414566268/control/data
[junit4:junit4]   2> 1785377 T5499 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372414566268/control/data/index/
[junit4:junit4]   2> 1785377 T5499 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372414566268/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1785378 T5499 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372414566268/control/data/index
[junit4:junit4]   2> 1785383 T5499 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b6ffa80 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2474b185),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1785383 T5499 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1785387 T5499 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1785387 T5499 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1785388 T5499 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1785389 T5499 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1785390 T5499 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1785390 T5499 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1785390 T5499 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1785391 T5499 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1785392 T5499 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1785406 T5499 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1785415 T5499 oass.SolrIndexSearcher.<init> Opening Searcher@64023199 main
[junit4:junit4]   2> 1785417 T5499 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1785418 T5499 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1785422 T5500 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@64023199 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1785424 T5499 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 1785424 T5499 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50859/x_avr/bb collection:control_collection shard:shard1
[junit4:junit4]   2> 1785426 T5499 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 1785442 T5499 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4:junit4]   2> 1785449 T5499 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1785449 T5499 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1785450 T5499 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50859/x_avr/bb/collection1/
[junit4:junit4]   2> 1785450 T5499 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1785450 T5499 oasc.SyncStrategy.syncToMe http://127.0.0.1:50859/x_avr/bb/collection1/ has no replicas
[junit4:junit4]   2> 1785451 T5499 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50859/x_avr/bb/collection1/ shard1
[junit4:junit4]   2> 1785451 T5499 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 1786819 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1786840 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 1786867 T5499 oasc.ZkController.register We are http://127.0.0.1:50859/x_avr/bb/collection1/ and leader is http://127.0.0.1:50859/x_avr/bb/collection1/
[junit4:junit4]   2> 1786868 T5499 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50859/x_avr/bb
[junit4:junit4]   2> 1786868 T5499 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 1786869 T5499 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 1786869 T5499 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1786872 T5499 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1786875 T5474 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1786876 T5474 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1786878 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1786900 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 1786905 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1786911 T5503 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a5f6ad5 name:ZooKeeperConnection Watcher:127.0.0.1:50856/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1786911 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1786914 T5474 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 1786920 T5474 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 1787358 T5474 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 1787363 T5474 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50863
[junit4:junit4]   2> 1787365 T5474 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1787365 T5474 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1787366 T5474 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372414571875
[junit4:junit4]   2> 1787367 T5474 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372414571875/solr.xml
[junit4:junit4]   2> 1787367 T5474 oasc.CoreContainer.<init> New CoreContainer 271335508
[junit4:junit4]   2> 1787368 T5474 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372414571875/'
[junit4:junit4]   2> 1787368 T5474 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372414571875/'
[junit4:junit4]   2> 1787516 T5474 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1787517 T5474 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1787518 T5474 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1787518 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1787519 T5474 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1787520 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1787520 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1787521 T5474 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1787521 T5474 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1787522 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1787541 T5474 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 1787542 T5474 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50856/solr
[junit4:junit4]   2> 1787542 T5474 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1787544 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1787548 T5514 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ab71b4e name:ZooKeeperConnection Watcher:127.0.0.1:50856 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1787549 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1787553 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1787569 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1787579 T5516 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@195d4817 name:ZooKeeperConnection Watcher:127.0.0.1:50856/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1787579 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1787588 T5474 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 1788351 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1788353 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50859_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50859/x_avr/bb"}
[junit4:junit4]   2> 1788362 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 1788362 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 1788362 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 1788599 T5474 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50863_x_avr%2Fbb
[junit4:junit4]   2> 1788603 T5474 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50863_x_avr%2Fbb
[junit4:junit4]   2> 1788609 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 1788609 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 1788611 T5516 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1788612 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1788616 T5496 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1788618 T5503 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 1788634 T5517 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1788635 T5517 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1788638 T5517 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4]   2> 1789877 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1789879 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50863_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50863/x_avr/bb"}
[junit4:junit4]   2> 1789879 T5497 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 1789880 T5497 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 1789891 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1789892 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1789891 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1790640 T5517 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4]   2> 1790640 T5517 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372414571875/collection1
[junit4:junit4]   2> 1790641 T5517 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 1790642 T5517 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1790642 T5517 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 1790645 T5517 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372414571875/collection1/'
[junit4:junit4]   2> 1790647 T5517 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372414571875/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1790648 T5517 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1372414571875/collection1/lib/README' to classloader
[junit4:junit4]   2> 1790722 T5517 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1790817 T5517 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1790820 T5517 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1790828 T5517 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 1791797 T5517 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1791813 T5517 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1791819 T5517 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1791856 T5517 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1791865 T5517 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1791875 T5517 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1791878 T5517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1791879 T5517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1791880 T5517 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1791883 T5517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1791884 T5517 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1791884 T5517 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1791885 T5517 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1372414571875/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty1/
[junit4:junit4]   2> 1791885 T5517 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a04648b
[junit4:junit4]   2> 1791886 T5517 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty1
[junit4:junit4]   2> 1791887 T5517 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty1/index/
[junit4:junit4]   2> 1791887 T5517 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1791887 T5517 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty1/index
[junit4:junit4]   2> 1791892 T5517 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bcd36c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e431790),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1791892 T5517 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1791897 T5517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1791897 T5517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1791898 T5517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1791900 T5517 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1791902 T5517 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1791902 T5517 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1791903 T5517 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1791904 T5517 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1791905 T5517 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1791921 T5517 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1791930 T5517 oass.SolrIndexSearcher.<init> Opening Searcher@4783cd81 main
[junit4:junit4]   2> 1791932 T5517 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1791933 T5517 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1791940 T5518 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4783cd81 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1791945 T5517 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 1791945 T5517 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50863/x_avr/bb collection:collection1 shard:shard1
[junit4:junit4]   2> 1791947 T5517 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 1791969 T5517 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4:junit4]   2> 1791976 T5517 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 1791976 T5517 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 1791977 T5517 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50863/x_avr/bb/collection1/
[junit4:junit4]   2> 1791977 T5517 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1791977 T5517 oasc.SyncStrategy.syncToMe http://127.0.0.1:50863/x_avr/bb/collection1/ has no replicas
[junit4:junit4]   2> 1791978 T5517 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50863/x_avr/bb/collection1/ shard1
[junit4:junit4]   2> 1791978 T5517 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 1792912 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1792929 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1792930 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1792930 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1792936 T5517 oasc.ZkController.register We are http://127.0.0.1:50863/x_avr/bb/collection1/ and leader is http://127.0.0.1:50863/x_avr/bb/collection1/
[junit4:junit4]   2> 1792937 T5517 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50863/x_avr/bb
[junit4:junit4]   2> 1792937 T5517 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 1792937 T5517 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 1792938 T5517 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1792941 T5517 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1792946 T5474 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1792948 T5474 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1792949 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1793423 T5474 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 1793429 T5474 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50866
[junit4:junit4]   2> 1793432 T5474 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1793433 T5474 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1793434 T5474 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372414577933
[junit4:junit4]   2> 1793435 T5474 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372414577933/solr.xml
[junit4:junit4]   2> 1793435 T5474 oasc.CoreContainer.<init> New CoreContainer 1724140342
[junit4:junit4]   2> 1793436 T5474 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372414577933/'
[junit4:junit4]   2> 1793437 T5474 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372414577933/'
[junit4:junit4]   2> 1793637 T5474 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1793638 T5474 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1793638 T5474 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1793639 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1793640 T5474 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1793640 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1793641 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1793642 T5474 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1793642 T5474 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1793643 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1793664 T5474 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 1793665 T5474 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50856/solr
[junit4:junit4]   2> 1793666 T5474 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1793668 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1793674 T5530 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ec99b97 name:ZooKeeperConnection Watcher:127.0.0.1:50856 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1793675 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1793680 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1793699 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1793704 T5532 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72af9904 name:ZooKeeperConnection Watcher:127.0.0.1:50856/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1793705 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1793717 T5474 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 1794452 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1794454 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50863_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50863/x_avr/bb"}
[junit4:junit4]   2> 1794467 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1794467 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1794467 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1794467 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1794729 T5474 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50866_x_avr%2Fbb
[junit4:junit4]   2> 1794733 T5474 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50866_x_avr%2Fbb
[junit4:junit4]   2> 1794739 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1794740 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1794740 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 1794742 T5516 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 1794743 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1794749 T5532 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 1794751 T5496 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 1794752 T5503 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 1794770 T5533 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1794770 T5533 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1794773 T5533 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4]   2> 1795984 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1795986 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node2",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50866_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50866/x_avr/bb"}
[junit4:junit4]   2> 1795986 T5497 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 1795987 T5497 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 1796001 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1796002 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1796002 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1796003 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1796777 T5533 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4]   2> 1796778 T5533 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372414577933/collection1
[junit4:junit4]   2> 1796778 T5533 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 1796780 T5533 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1796781 T5533 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 1796785 T5533 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372414577933/collection1/'
[junit4:junit4]   2> 1796786 T5533 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372414577933/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1796787 T5533 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1372414577933/collection1/lib/README' to classloader
[junit4:junit4]   2> 1796866 T5533 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1796957 T5533 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1796960 T5533 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1796967 T5533 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 1797935 T5533 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1797959 T5533 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1797966 T5533 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1798003 T5533 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1798017 T5533 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1798032 T5533 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1798037 T5533 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1798038 T5533 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1798039 T5533 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1798046 T5533 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1798047 T5533 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1798048 T5533 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1798049 T5533 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1372414577933/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty2/
[junit4:junit4]   2> 1798053 T5533 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a04648b
[junit4:junit4]   2> 1798055 T5533 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty2
[junit4:junit4]   2> 1798056 T5533 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty2/index/
[junit4:junit4]   2> 1798056 T5533 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1798057 T5533 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty2/index
[junit4:junit4]   2> 1798069 T5533 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a0cdad5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@26516c43),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1798069 T5533 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1798082 T5533 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1798083 T5533 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1798084 T5533 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1798087 T5533 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1798091 T5533 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1798092 T5533 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1798093 T5533 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1798094 T5533 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1798095 T5533 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1798119 T5533 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1798132 T5533 oass.SolrIndexSearcher.<init> Opening Searcher@7db3b95 main
[junit4:junit4]   2> 1798135 T5533 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1798136 T5533 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1798146 T5534 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7db3b95 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1798151 T5533 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 1798151 T5533 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50866/x_avr/bb collection:collection1 shard:shard1
[junit4:junit4]   2> 1798161 T5533 oasc.ZkController.register We are http://127.0.0.1:50866/x_avr/bb/collection1/ and leader is http://127.0.0.1:50863/x_avr/bb/collection1/
[junit4:junit4]   2> 1798161 T5533 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50866/x_avr/bb
[junit4:junit4]   2> 1798162 T5533 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 1798162 T5533 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C728 name=collection1 org.apache.solr.core.SolrCore@53539c88 url=http://127.0.0.1:50866/x_avr/bb/collection1 node=127.0.0.1:50866_x_avr%2Fbb C728_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:50866_x_avr%2Fbb, base_url=http://127.0.0.1:50866/x_avr/bb}
[junit4:junit4]   2> 1798164 T5535 C728 P50866 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 1798165 T5535 C728 P50866 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 1798165 T5535 C728 P50866 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 1798166 T5535 C728 P50866 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1798165 T5533 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1798169 T5535 C728 P50866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1798171 T5474 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1798172 T5474 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1798173 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1798207 T5507 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 1798670 T5474 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 1798677 T5474 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50870
[junit4:junit4]   2> 1798680 T5474 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1798681 T5474 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1798681 T5474 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372414583156
[junit4:junit4]   2> 1798682 T5474 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372414583156/solr.xml
[junit4:junit4]   2> 1798682 T5474 oasc.CoreContainer.<init> New CoreContainer 632182667
[junit4:junit4]   2> 1798683 T5474 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372414583156/'
[junit4:junit4]   2> 1798684 T5474 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372414583156/'
[junit4:junit4]   2> 1798833 T5474 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1798834 T5474 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1798834 T5474 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1798835 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1798835 T5474 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1798836 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1798836 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1798837 T5474 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1798837 T5474 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1798838 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1798857 T5474 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 1798858 T5474 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50856/solr
[junit4:junit4]   2> 1798859 T5474 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1798860 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1798866 T5547 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b077db7 name:ZooKeeperConnection Watcher:127.0.0.1:50856 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1798868 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1798873 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1798892 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1798896 T5549 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76ba3c96 name:ZooKeeperConnection Watcher:127.0.0.1:50856/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1798897 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1798907 T5474 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 1799025 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1799027 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node2",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50866_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50866/x_avr/bb"}
[junit4:junit4]   2> 1799039 T5549 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1799040 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1799040 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1799039 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1799039 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1799209 T5507 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   2> 1799211 T5507 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node2&state=recovering&nodeName=127.0.0.1:50866_x_avr%252Fbb&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1004
[junit4:junit4]   2> 1799924 T5474 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50870_x_avr%2Fbb
[junit4:junit4]   2> 1799930 T5474 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50870_x_avr%2Fbb
[junit4:junit4]   2> 1799936 T5549 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1799936 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1799937 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1799937 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 1799939 T5516 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 1799940 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1799945 T5549 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 1799945 T5503 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 1799947 T5532 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 1799947 T5496 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 1799960 T5550 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1799961 T5550 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1799966 T5550 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4]   2> 1800560 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1800562 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50870_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50870/x_avr/bb"}
[junit4:junit4]   2> 1800562 T5497 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 1800563 T5497 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 1800574 T5549 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1800574 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1800574 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1800575 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1800575 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1800972 T5550 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4]   2> 1800973 T5550 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372414583156/collection1
[junit4:junit4]   2> 1800973 T5550 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 1800975 T5550 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1800975 T5550 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 1800980 T5550 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372414583156/collection1/'
[junit4:junit4]   2> 1800981 T5550 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372414583156/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1800982 T5550 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1372414583156/collection1/lib/README' to classloader
[junit4:junit4]   2> 1801072 T5550 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1801197 T5550 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1801201 T5550 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1801212 T5550 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2>  C728_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:50866_x_avr%2Fbb, base_url=http://127.0.0.1:50866/x_avr/bb}
[junit4:junit4]   2> 1801213 T5535 C728 P50866 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50863/x_avr/bb/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 1801214 T5535 C728 P50866 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50866/x_avr/bb START replicas=[http://127.0.0.1:50863/x_avr/bb/collection1/] nUpdates=100
[junit4:junit4]   2> 1801215 T5535 C728 P50866 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 1801219 T5535 C728 P50866 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 1801230 T5535 C728 P50866 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 1801230 T5535 C728 P50866 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 1801231 T5535 C728 P50866 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 1801231 T5535 C728 P50866 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50863/x_avr/bb/collection1/. core=collection1
[junit4:junit4]   2> 1801232 T5535 C728 P50866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C729 name=collection1 org.apache.solr.core.SolrCore@590d2c5f url=http://127.0.0.1:50863/x_avr/bb/collection1 node=127.0.0.1:50863_x_avr%2Fbb C729_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50863_x_avr%2Fbb, base_url=http://127.0.0.1:50863/x_avr/bb, leader=true}
[junit4:junit4]   2> 1801233 T5507 C729 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 1801263 T5511 C729 P50863 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1801275 T5511 C729 P50863 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bcd36c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e431790),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1801277 T5511 C729 P50863 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1801277 T5511 C729 P50863 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 1801278 T5511 C729 P50863 oass.SolrIndexSearcher.<init> Opening Searcher@45e0dcf4 realtime
[junit4:junit4]   2> 1801281 T5511 C729 P50863 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1801282 T5511 C729 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 20
[junit4:junit4]   2> 1801286 T5535 C728 P50866 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 1801288 T5535 C728 P50866 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 1801296 T5508 C729 P50863 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 1801297 T5508 C729 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4]   2> 1801298 T5535 C728 P50866 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 1801299 T5535 C728 P50866 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 1801299 T5535 C728 P50866 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 1801299 T5535 C728 P50866 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1801302 T5535 C728 P50866 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 1802092 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1802094 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node2",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50866_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50866/x_avr/bb"}
[junit4:junit4]   2> 1802114 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1802115 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1802114 T5549 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1802115 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1802115 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1802554 T5550 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1802569 T5550 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1802575 T5550 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1802630 T5550 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1802638 T5550 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1802650 T5550 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1802654 T5550 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1802656 T5550 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1802656 T5550 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1802659 T5550 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1802659 T5550 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1802660 T5550 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1802660 T5550 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1372414583156/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty3/
[junit4:junit4]   2> 1802661 T5550 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a04648b
[junit4:junit4]   2> 1802662 T5550 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty3
[junit4:junit4]   2> 1802666 T5550 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty3/index/
[junit4:junit4]   2> 1802668 T5550 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1802668 T5550 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty3/index
[junit4:junit4]   2> 1802673 T5550 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5941403d lockFactory=org.apache.lucene.store.NativeFSLockFactory@e8473b4),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1802674 T5550 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1802685 T5550 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1802686 T5550 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1802688 T5550 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1802690 T5550 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1802692 T5550 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1802692 T5550 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1802695 T5550 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1802697 T5550 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1802698 T5550 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1802724 T5550 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1802736 T5550 oass.SolrIndexSearcher.<init> Opening Searcher@7d78ff18 main
[junit4:junit4]   2> 1802738 T5550 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1802739 T5550 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1802752 T5552 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7d78ff18 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1802762 T5550 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 1802763 T5550 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50870/x_avr/bb collection:collection1 shard:shard1
[junit4:junit4]   2> 1802774 T5550 oasc.ZkController.register We are http://127.0.0.1:50870/x_avr/bb/collection1/ and leader is http://127.0.0.1:50863/x_avr/bb/collection1/
[junit4:junit4]   2> 1802775 T5550 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50870/x_avr/bb
[junit4:junit4]   2> 1802776 T5550 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 1802777 T5550 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C730 name=collection1 org.apache.solr.core.SolrCore@3cc2566c url=http://127.0.0.1:50870/x_avr/bb/collection1 node=127.0.0.1:50870_x_avr%2Fbb C730_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:50870_x_avr%2Fbb, base_url=http://127.0.0.1:50870/x_avr/bb}
[junit4:junit4]   2> 1802779 T5553 C730 P50870 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 1802779 T5553 C730 P50870 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 1802780 T5553 C730 P50870 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 1802780 T5553 C730 P50870 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1802781 T5550 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1802786 T5553 C730 P50870 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1802814 T5474 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1802816 T5474 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1802817 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1802824 T5511 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 1803373 T5474 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4]   2> 1803382 T5474 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50877
[junit4:junit4]   2> 1803385 T5474 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1803385 T5474 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1803386 T5474 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372414587795
[junit4:junit4]   2> 1803387 T5474 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372414587795/solr.xml
[junit4:junit4]   2> 1803388 T5474 oasc.CoreContainer.<init> New CoreContainer 447102684
[junit4:junit4]   2> 1803390 T5474 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372414587795/'
[junit4:junit4]   2> 1803391 T5474 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372414587795/'
[junit4:junit4]   2> 1803650 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1803652 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50870_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50870/x_avr/bb"}
[junit4:junit4]   2> 1803667 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1803668 T5549 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1803669 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1803668 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1803669 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1803745 T5474 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1803747 T5474 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1803748 T5474 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1803749 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1803750 T5474 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1803751 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1803752 T5474 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1803753 T5474 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1803754 T5474 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1803755 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1803786 T5474 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4]   2> 1803788 T5474 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50856/solr
[junit4:junit4]   2> 1803790 T5474 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1803795 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1803801 T5565 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e28a6f2 name:ZooKeeperConnection Watcher:127.0.0.1:50856 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1803803 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1803810 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1803827 T5511 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   2> 1803828 T5511 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node3&state=recovering&nodeName=127.0.0.1:50870_x_avr%252Fbb&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1003
[junit4:junit4]   2> 1803840 T5474 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1803846 T5567 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a2afed5 name:ZooKeeperConnection Watcher:127.0.0.1:50856/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1803846 T5474 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1803861 T5474 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 1804873 T5474 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50877_x_avr%2Fbb
[junit4:junit4]   2> 1804876 T5474 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50877_x_avr%2Fbb
[junit4:junit4]   2> 1804882 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1804883 T5549 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1804883 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1804883 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 1804887 T5567 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1804887 T5516 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1804888 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1804891 T5503 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1804894 T5532 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1804894 T5496 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1804895 T5549 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 1804911 T5568 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1804912 T5568 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1804915 T5568 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4:junit4]   2> 1805196 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1805198 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50877_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50877/x_avr/bb"}
[junit4:junit4]   2> 1805198 T5497 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 1805199 T5497 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 1805209 T5567 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1805209 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1805210 T5549 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1805210 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1805209 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1805210 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2>  C730_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:50870_x_avr%2Fbb, base_url=http://127.0.0.1:50870/x_avr/bb}
[junit4:junit4]   2> 1805840 T5553 C730 P50870 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50863/x_avr/bb/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 1805841 T5553 C730 P50870 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50870/x_avr/bb START replicas=[http://127.0.0.1:50863/x_avr/bb/collection1/] nUpdates=100
[junit4:junit4]   2> 1805842 T5553 C730 P50870 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 1805843 T5553 C730 P50870 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 1805843 T5553 C730 P50870 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 1805843 T5553 C730 P50870 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 1805843 T5553 C730 P50870 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 1805844 T5553 C730 P50870 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50863/x_avr/bb/collection1/. core=collection1
[junit4:junit4]   2> 1805844 T5553 C730 P50870 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C731 name=collection1 org.apache.solr.core.SolrCore@590d2c5f url=http://127.0.0.1:50863/x_avr/bb/collection1 node=127.0.0.1:50863_x_avr%2Fbb C731_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50863_x_avr%2Fbb, base_url=http://127.0.0.1:50863/x_avr/bb, leader=true}
[junit4:junit4]   2> 1805848 T5511 C731 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 1805872 T5507 C731 P50863 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1805873 T5507 C731 P50863 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 1805875 T5507 C731 P50863 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1805876 T5507 C731 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4]   2> 1805878 T5553 C730 P50870 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 1805878 T5553 C730 P50870 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 1805883 T5512 C731 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 1805884 T5553 C730 P50870 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 1805885 T5553 C730 P50870 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 1805885 T5553 C730 P50870 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 1805886 T5553 C730 P50870 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1805890 T5553 C730 P50870 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 1805918 T5568 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4:junit4]   2> 1805919 T5568 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372414587795/collection1
[junit4:junit4]   2> 1805919 T5568 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 1805921 T5568 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1805922 T5568 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 1805926 T5568 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372414587795/collection1/'
[junit4:junit4]   2> 1805928 T5568 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372414587795/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1805929 T5568 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1372414587795/collection1/lib/README' to classloader
[junit4:junit4]   2> 1806014 T5568 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1806095 T5568 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1806098 T5568 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4]   2> 1806110 T5568 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4]   2> 1806726 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1806728 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50870_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50870/x_avr/bb"}
[junit4:junit4]   2> 1806740 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1806741 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1806741 T5549 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1806741 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1806741 T5567 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1806741 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1807093 T5568 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1807109 T5568 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1807115 T5568 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1807154 T5568 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1807164 T5568 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1807172 T5568 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1807176 T5568 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1807177 T5568 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1807178 T5568 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1807181 T5568 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1807181 T5568 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4]   2> 1807182 T5568 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1807182 T5568 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1372414587795/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty4/
[junit4:junit4]   2> 1807182 T5568 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a04648b
[junit4:junit4]   2> 1807184 T5568 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty4
[junit4:junit4]   2> 1807184 T5568 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty4/index/
[junit4:junit4]   2> 1807185 T5568 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1807185 T5568 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1372414566268/jetty4/index
[junit4:junit4]   2> 1807190 T5568 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2c5554a3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b36df82),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1807191 T5568 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1807197 T5568 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1807198 T5568 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1807199 T5568 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1807200 T5568 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1807201 T5568 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1807202 T5568 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1807204 T5568 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1807205 T5568 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1807206 T5568 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1807223 T5568 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1807232 T5568 oass.SolrIndexSearcher.<init> Opening Searcher@51b203a1 main
[junit4:junit4]   2> 1807234 T5568 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1807234 T5568 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1807242 T5570 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@51b203a1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1807247 T5568 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 1807247 T5568 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50877/x_avr/bb collection:collection1 shard:shard1
[junit4:junit4]   2> 1807255 T5568 oasc.ZkController.register We are http://127.0.0.1:50877/x_avr/bb/collection1/ and leader is http://127.0.0.1:50863/x_avr/bb/collection1/
[junit4:junit4]   2> 1807256 T5568 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50877/x_avr/bb
[junit4:junit4]   2> 1807256 T5568 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 1807257 T5568 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C732 name=collection1 org.apache.solr.core.SolrCore@11e2dbfa url=http://127.0.0.1:50877/x_avr/bb/collection1 node=127.0.0.1:50877_x_avr%2Fbb C732_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, node_name=127.0.0.1:50877_x_avr%2Fbb, base_url=http://127.0.0.1:50877/x_avr/bb}
[junit4:junit4]   2> 1807258 T5571 C732 P50877 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 1807259 T5571 C732 P50877 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 1807259 T5568 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1807259 T5571 C732 P50877 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 1807260 T5571 C732 P50877 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1807263 T5474 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 1807265 T5474 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 1807264 T5571 C732 P50877 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1807266 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1807290 T5474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1807291 T5507 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   2> 1807293 T5474 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 30 for each attempt
[junit4:junit4]   2> 1807293 T5474 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30
[junit4:junit4]   2> 1807295 T5474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1808266 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1808268 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50877_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50877/x_avr/bb"}
[junit4:junit4]   2> 1808279 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1808279 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1808279 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1808280 T5549 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1808279 T5567 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1808281 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1808300 T5507 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   2> 1808301 T5507 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=core_node4&state=recovering&nodeName=127.0.0.1:50877_x_avr%252Fbb&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1010
[junit4:junit4]   2> 1808302 T5474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1809307 T5474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2>  C732_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, node_name=127.0.0.1:50877_x_avr%2Fbb, base_url=http://127.0.0.1:50877/x_avr/bb}
[junit4:junit4]   2> 1810308 T5571 C732 P50877 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50863/x_avr/bb/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 1810308 T5571 C732 P50877 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50877/x_avr/bb START replicas=[http://127.0.0.1:50863/x_avr/bb/collection1/] nUpdates=100
[junit4:junit4]   2> 1810310 T5571 C732 P50877 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 1810310 T5571 C732 P50877 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 1810311 T5571 C732 P50877 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 1810311 T5571 C732 P50877 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 1810312 T5571 C732 P50877 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 1810312 T5571 C732 P50877 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50863/x_avr/bb/collection1/. core=collection1
[junit4:junit4]   2> 1810313 T5571 C732 P50877 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C733 name=collection1 org.apache.solr.core.SolrCore@590d2c5f url=http://127.0.0.1:50863/x_avr/bb/collection1 node=127.0.0.1:50863_x_avr%2Fbb C733_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50863_x_avr%2Fbb, base_url=http://127.0.0.1:50863/x_avr/bb, leader=true}
[junit4:junit4]   2> 1810313 T5507 C733 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 1810315 T5474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1810341 T5511 C733 P50863 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1810343 T5511 C733 P50863 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 1810343 T5511 C733 P50863 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1810344 T5511 C733 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4]   2> 1810346 T5571 C732 P50877 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 1810347 T5571 C732 P50877 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 1810350 T5509 C733 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 1810352 T5571 C732 P50877 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 1810353 T5571 C732 P50877 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 1810353 T5571 C732 P50877 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 1810354 T5571 C732 P50877 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1810357 T5571 C732 P50877 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 1811304 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1811306 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "shard_state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "shard_range":null,
[junit4:junit4]   2>  "node_name":"127.0.0.1:50877_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50877/x_avr/bb"}
[junit4:junit4]   2> 1811321 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1811322 T5549 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1811322 T5567 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1811322 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1811324 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1811324 T5503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1811326 T5474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1811331 T5474 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C734 name=collection1 org.apache.solr.core.SolrCore@68f5c3ef url=http://127.0.0.1:50859/x_avr/bb/collection1 node=127.0.0.1:50859_x_avr%2Fbb C734_STATE=coll:control_collection core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50859_x_avr%2Fbb, base_url=http://127.0.0.1:50859/x_avr/bb, leader=true}
[junit4:junit4]   2> 1811356 T5492 C734 P50859 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1811363 T5492 C734 P50859 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b6ffa80 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2474b185),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1811366 T5492 C734 P50859 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1811367 T5492 C734 P50859 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 1811368 T5492 C734 P50859 oass.SolrIndexSearcher.<init> Opening Searcher@728960e9 main
[junit4:junit4]   2> 1811369 T5492 C734 P50859 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1811372 T5500 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@728960e9 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 1811374 T5492 C734 P50859 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4]   2> ASYNC  NEW_CORE C735 name=collection1 org.apache.solr.core.SolrCore@3cc2566c url=http://127.0.0.1:50870/x_avr/bb/collection1 node=127.0.0.1:50870_x_avr%2Fbb C735_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50870_x_avr%2Fbb, base_url=http://127.0.0.1:50870/x_avr/bb}
[junit4:junit4]   2> 1811419 T5540 C735 P50870 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:50863/x_avr/bb/collection1/, StdNode: http://127.0.0.1:50866/x_avr/bb/collection1/, StdNode: http://127.0.0.1:50870/x_avr/bb/collection1/, StdNode: http://127.0.0.1:50877/x_avr/bb/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 1811439 T5508 C733 P50863 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1811440 T5508 C733 P50863 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 1811442 T5508 C733 P50863 oass.SolrIndexSearcher.<init> Opening Searcher@450da6b4 main
[junit4:junit4]   2> 1811443 T5508 C733 P50863 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1811446 T5518 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@450da6b4 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> ASYNC  NEW_CORE C736 name=collection1 org.apache.solr.core.SolrCore@53539c88 url=http://127.0.0.1:50866/x_avr/bb/collection1 node=127.0.0.1:50866_x_avr%2Fbb C736_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50866_x_avr%2Fbb, base_url=http://127.0.0.1:50866/x_avr/bb}
[junit4:junit4]   2> 1811453 T5523 C736 P50866 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1811457 T5508 C733 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4]   2> 1811460 T5541 C735 P50870 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1811467 T5541 C735 P50870 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5941403d lockFactory=org.apache.lucene.store.NativeFSLockFactory@e8473b4),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1811469 T5541 C735 P50870 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1811471 T5541 C735 P50870 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2>  C732_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, node_name=127.0.0.1:50877_x_avr%2Fbb, base_url=http://127.0.0.1:50877/x_avr/bb}
[junit4:junit4]   2> 1811468 T5558 C732 P50877 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1811473 T5541 C735 P50870 oass.SolrIndexSearcher.<init> Opening Searcher@5375b359 main
[junit4:junit4]   2> 1811477 T5541 C735 P50870 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1811470 T5523 C736 P50866 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a0cdad5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@26516c43),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1811478 T5523 C736 P50866 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1811479 T5523 C736 P50866 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 1811480 T5552 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5375b359 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 1811482 T5558 C732 P50877 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2c5554a3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b36df82),segFN=segments_1,generation=1}
[junit4:junit4]   2> 1811483 T5558 C732 P50877 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4]   2> 1811485 T5558 C732 P50877 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 1811484 T5541 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 24
[junit4:junit4]   2> 1811487 T5558 C732 P50877 oass.SolrIndexSearcher.<init> Opening Searcher@3071f3a main
[junit4:junit4]   2> 1811489 T5558 C732 P50877 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1811485 T5523 C736 P50866 oass.SolrIndexSearcher.<init> Opening Searcher@7f5b7ee4 main
[junit4:junit4]   2> 1811491 T5523 C736 P50866 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1811491 T5570 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3071f3a main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 1811493 T5558 C732 P50877 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4]   2> 1811494 T5534 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7f5b7ee4 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4:junit4]   2> 1811496 T5523 C736 P50866 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 43
[junit4:junit4]   2> 1811497 T5540 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 79
[junit4:junit4]   2> 1811501 T5474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1811509 T5511 C733 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4]   2> 1811518 T5524 C736 P50866 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=2
[junit4:junit4]   2> 1811524 T5542 C735 P50870 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4]   2> 1811531 T5560 C732 P50877 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4]   2> 1813541 T5492 C734 P50859 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1439081010029395968)} 0 3
[junit4:junit4]   2> 1813567 T5542 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={update.distrib=FROMLEADER&_version_=-1439081010038833152&update.from=http://127.0.0.1:50863/x_avr/bb/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1439081010038833152)} 0 5
[junit4:junit4]   2> 1813570 T5524 C736 P50866 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={update.distrib=FROMLEADER&_version_=-1439081010038833152&update.from=http://127.0.0.1:50863/x_avr/bb/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1439081010038833152)} 0 6
[junit4:junit4]   2> 1813572 T5560 C732 P50877 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={update.distrib=FROMLEADER&_version_=-1439081010038833152&update.from=http://127.0.0.1:50863/x_avr/bb/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1439081010038833152)} 0 10
[junit4:junit4]   2> 1813574 T5511 C733 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1439081010038833152)} 0 28
[junit4:junit4]   2> 1813586 T5487 C734 P50859 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={wt=javabin&version=2} {add=[0 (1439081010075533312)]} 0 5
[junit4:junit4]   2> 1813605 T5544 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1439081010090213376)]} 0 2
[junit4:junit4]   2> 1813610 T5525 C736 P50866 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1439081010090213376)]} 0 2
[junit4:junit4]   2> 1813612 T5561 C732 P50877 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1439081010090213376)]} 0 4
[junit4:junit4]   2> 1813615 T5510 C733 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50870/x_avr/bb/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1439081010090213376)]} 0 19
[junit4:junit4]   2> 1813617 T5543 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={wt=javabin&version=2} {add=[0]} 0 26
[junit4:junit4]   2> 1813626 T5488 C734 P50859 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={wt=javabin&version=2} {add=[1 (1439081010118524928)]} 0 4
[junit4:junit4]   2> 1813645 T5562 C732 P50877 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1439081010129010688)]} 0 3
[junit4:junit4]   2> 1813652 T5526 C736 P50866 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1439081010129010688)]} 0 3
[junit4:junit4]   2> 1813653 T5545 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1439081010129010688)]} 0 3
[junit4:junit4]   2> 1813657 T5509 C733 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={wt=javabin&version=2} {add=[1 (1439081010129010688)]} 0 25
[junit4:junit4]   2> 1813667 T5489 C734 P50859 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={wt=javabin&version=2} {add=[2 (1439081010161516544)]} 0 4
[junit4:junit4]   2> 1813682 T5512 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:50866/x_avr/bb/collection1/]
[junit4:junit4]   2> 1813683 T5512 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50866/x_avr/bb/collection1/ against:[http://127.0.0.1:50866/x_avr/bb/collection1/] result:true
[junit4:junit4]   2> 1813684 T5512 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50870/x_avr/bb/collection1/ against:[http://127.0.0.1:50866/x_avr/bb/collection1/] result:false
[junit4:junit4]   2> 1813684 T5512 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50877/x_avr/bb/collection1/ against:[http://127.0.0.1:50866/x_avr/bb/collection1/] result:false
[junit4:junit4]   2> 1813698 T5557 C732 P50877 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50866/x_avr/bb/collection1/&wt=javabin&version=2} {add=[2 (1439081010183536640)]} 0 4
[junit4:junit4]   2> 1813705 T5541 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50866/x_avr/bb/collection1/&wt=javabin&version=2} {add=[2 (1439081010183536640)]} 0 4
[junit4:junit4]   2> 1813707 T5512 C733 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50866/x_avr/bb/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:50866/x_avr/bb/collection1/&wt=javabin&version=2} {add=[2 (1439081010183536640)]} 0 26
[junit4:junit4]   2> 1813710 T5527 C736 P50866 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={test.distrib.skip.servers=http://127.0.0.1:50866/x_avr/bb/collection1/&wt=javabin&version=2} {add=[2]} 0 37
[junit4:junit4]   2> 1813732 T5490 C734 P50859 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={wt=javabin&version=2} {add=[3 (1439081010216042496)]} 0 16
[junit4:junit4]   2> 1813742 T5507 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:50866/x_avr/bb/collection1/]
[junit4:junit4]   2> 1813743 T5507 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50866/x_avr/bb/collection1/ against:[http://127.0.0.1:50866/x_avr/bb/collection1/] result:true
[junit4:junit4]   2> 1813744 T5507 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50870/x_avr/bb/collection1/ against:[http://127.0.0.1:50866/x_avr/bb/collection1/] result:false
[junit4:junit4]   2> 1813745 T5507 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50877/x_avr/bb/collection1/ against:[http://127.0.0.1:50866/x_avr/bb/collection1/] result:false
[junit4:junit4]   2> 1813754 T5542 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50866/x_avr/bb/collection1/&wt=javabin&version=2} {add=[3 (1439081010246451200)]} 0 3
[junit4:junit4]   2> 1813755 T5558 C732 P50877 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50866/x_avr/bb/collection1/&wt=javabin&version=2} {add=[3 (1439081010246451200)]} 0 3
[junit4:junit4]   2> 1813757 T5507 C733 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50870/x_avr/bb/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:50866/x_avr/bb/collection1/&wt=javabin&version=2} {add=[3 (1439081010246451200)]} 0 15
[junit4:junit4]   2> 1813759 T5540 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={test.distrib.skip.servers=http://127.0.0.1:50866/x_avr/bb/collection1/&test.distrib.skip.servers=http://127.0.0.1:50870/x_avr/bb/collection1/&wt=javabin&version=2} {add=[3]} 0 22
[junit4:junit4]   2> 1813764 T5491 C734 P50859 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1813779 T5491 C734 P50859 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b6ffa80 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2474b185),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b6ffa80 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2474b185),segFN=segments_2,generation=2}
[junit4:junit4]   2> 1813781 T5491 C734 P50859 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 1813787 T5491 C734 P50859 oass.SolrIndexSearcher.<init> Opening Searcher@79bb6355 main
[junit4:junit4]   2> 1813788 T5491 C734 P50859 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1813790 T5500 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@79bb6355 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 1813791 T5491 C734 P50859 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 27
[junit4:junit4]   2> 1813799 T5528 C736 P50866 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:50863/x_avr/bb/collection1/, StdNode: http://127.0.0.1:50866/x_avr/bb/collection1/, StdNode: http://127.0.0.1:50870/x_avr/bb/collection1/, StdNode: http://127.0.0.1:50877/x_avr/bb/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 1813805 T5508 C733 P50863 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1813813 T5523 C736 P50866 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1813816 T5559 C732 P50877 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1813826 T5544 C735 P50870 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1813845 T5559 C732 P50877 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2c5554a3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b36df82),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2c5554a3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b36df82),segFN=segments_2,generation=2}
[junit4:junit4]   2> 1813852 T5559 C732 P50877 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 1813858 T5508 C733 P50863 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bcd36c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e431790),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bcd36c0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e431790),segFN=segments_2,generation=2}
[junit4:junit4]   2> 1813859 T5508 C733 P50863 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 1813861 T5559 C732 P50877 oass.SolrIndexSearcher.<init> Opening Searcher@1308d2a0 main
[junit4:junit4]   2> 1813862 T5559 C732 P50877 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1813864 T5570 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1308d2a0 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 1813865 T5559 C732 P50877 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 49
[junit4:junit4]   2> 1813872 T5508 C733 P50863 oass.SolrIndexSearcher.<init> Opening Searcher@516fecce main
[junit4:junit4]   2> 1813874 T5518 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@516fecce main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 1813875 T5508 C733 P50863 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1813875 T5508 C733 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 70
[junit4:junit4]   2> 1813879 T5523 C736 P50866 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a0cdad5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@26516c43),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a0cdad5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@26516c43),segFN=segments_2,generation=2}
[junit4:junit4]   2> 1813880 T5523 C736 P50866 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 1813883 T5523 C736 P50866 oass.SolrIndexSearcher.<init> Opening Searcher@7b33f285 main
[junit4:junit4]   2> 1813885 T5544 C735 P50870 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5941403d lockFactory=org.apache.lucene.store.NativeFSLockFactory@e8473b4),segFN=segments_1,generation=1}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5941403d lockFactory=org.apache.lucene.store.NativeFSLockFactory@e8473b4),segFN=segments_2,generation=2}
[junit4:junit4]   2> 1813885 T5523 C736 P50866 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1813886 T5544 C735 P50870 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4]   2> 1813888 T5534 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b33f285 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C2)}
[junit4:junit4]   2> 1813889 T5544 C735 P50870 oass.SolrIndexSearcher.<init> Opening Searcher@1ecd6cbb main
[junit4:junit4]   2> 1813890 T5523 C736 P50866 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 77
[junit4:junit4]   2> 1813892 T5544 C735 P50870 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1813894 T5552 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ecd6cbb main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 1813896 T5544 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 70
[junit4:junit4]   2> 1813901 T5528 C736 P50866 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 103
[junit4:junit4]   2> 1813903 T5474 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):330
[junit4:junit4]   2> 1813910 T5474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1813913 T5474 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> 1813918 T5511 C733 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2> 1813926 T5524 C736 P50866 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0
[junit4:junit4]   2> 1813936 T5543 C735 P50870 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2> 1813944 T5560 C732 P50877 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2> 1813946 T5474 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1813978 T5541 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4]   2> 1813979 T5541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 1814030 T5509 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4]   2> 1814031 T5509 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50863/x_avr/bb/collection1/
[junit4:junit4]   2> 1814031 T5509 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50863/x_avr/bb START replicas=[http://127.0.0.1:50866/x_avr/bb/collection1/, http://127.0.0.1:50870/x_avr/bb/collection1/, http://127.0.0.1:50877/x_avr/bb/collection1/] nUpdates=100
[junit4:junit4]   2> 1814042 T5542 C735 P50870 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 1814043 T5526 C736 P50866 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 1814044 T5509 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50863/x_avr/bb  Received 5 versions from 127.0.0.1:50870/x_avr/bb/collection1/
[junit4:junit4]   2> 1814045 T5509 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50863/x_avr/bb  Our versions are newer. ourLowThreshold=1439081010038833152 otherHigh=1439081010183536640
[junit4:junit4]   2> 1814046 T5509 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50863/x_avr/bb  Received 3 versions from 127.0.0.1:50866/x_avr/bb/collection1/
[junit4:junit4]   2> 1814046 T5509 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50863/x_avr/bb  Our versions are newer. ourLowThreshold=1439081010038833152 otherHigh=1439081010129010688
[junit4:junit4]   2> 1814045 T5562 C732 P50877 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 1814049 T5509 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50863/x_avr/bb  Received 5 versions from 127.0.0.1:50877/x_avr/bb/collection1/
[junit4:junit4]   2> 1814049 T5509 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50863/x_avr/bb  Our versions are newer. ourLowThreshold=1439081010038833152 otherHigh=1439081010183536640
[junit4:junit4]   2> 1814050 T5509 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50863/x_avr/bb DONE. sync succeeded
[junit4:junit4]   2> 1814050 T5509 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 1814050 T5509 oasc.SyncStrategy.syncToMe http://127.0.0.1:50863/x_avr/bb/collection1/: try and ask http://127.0.0.1:50866/x_avr/bb/collection1/ to sync
[junit4:junit4]   2> 1814052 T5509 oasc.SyncStrategy.syncToMe http://127.0.0.1:50863/x_avr/bb/collection1/: try and ask http://127.0.0.1:50870/x_avr/bb/collection1/ to sync
[junit4:junit4]   2> 1814053 T5509 oasc.SyncStrategy.syncToMe http://127.0.0.1:50863/x_avr/bb/collection1/: try and ask http://127.0.0.1:50877/x_avr/bb/collection1/ to sync
[junit4:junit4]   2> 1814059 T5527 C736 P50866 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50866/x_avr/bb START replicas=[http://127.0.0.1:50863/x_avr/bb/collection1/] nUpdates=100
[junit4:junit4]   2> 1814062 T5540 C735 P50870 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50870/x_avr/bb START replicas=[http://127.0.0.1:50863/x_avr/bb/collection1/] nUpdates=100
[junit4:junit4]   2> 1814062 T5557 C732 P50877 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50877/x_avr/bb START replicas=[http://127.0.0.1:50863/x_avr/bb/collection1/] nUpdates=100
[junit4:junit4]   2> 1814067 T5512 C733 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 1814071 T5512 C733 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 1814077 T5527 C736 P50866 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50866/x_avr/bb  Received 5 versions from 127.0.0.1:50863/x_avr/bb/collection1/
[junit4:junit4]   2> 1814078 T5540 C735 P50870 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50870/x_avr/bb  Received 5 versions from 127.0.0.1:50863/x_avr/bb/collection1/
[junit4:junit4]   2> 1814080 T5540 C735 P50870 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50870/x_avr/bb  Our versions are newer. ourLowThreshold=1439081010038833152 otherHigh=1439081010183536640
[junit4:junit4]   2> 1814081 T5540 C735 P50870 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50870/x_avr/bb DONE. sync succeeded
[junit4:junit4]   2> 1814079 T5527 C736 P50866 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:50866/x_avr/bb Requesting updates from 127.0.0.1:50863/x_avr/bb/collection1/n=2 versions=[1439081010246451200, 1439081010183536640]
[junit4:junit4]   2> 1814082 T5540 C735 P50870 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={sync=http://127.0.0.1:50863/x_avr/bb/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=20
[junit4:junit4]   2> 1814081 T5508 C733 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 1814085 T5509 oasc.SyncStrategy.syncToMe http://127.0.0.1:50863/x_avr/bb/collection1/:  sync completed with http://127.0.0.1:50870/x_avr/bb/collection1/
[junit4:junit4]   2> 1814086 T5557 C732 P50877 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50877/x_avr/bb  Received 5 versions from 127.0.0.1:50863/x_avr/bb/collection1/
[junit4:junit4]   2> 1814086 T5557 C732 P50877 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:50877/x_avr/bb  Our versions are newer. ourLowThreshold=1439081010038833152 otherHigh=1439081010183536640
[junit4:junit4]   2> 1814087 T5557 C732 P50877 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50877/x_avr/bb DONE. sync succeeded
[junit4:junit4]   2> 1814088 T5557 C732 P50877 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={sync=http://127.0.0.1:50863/x_avr/bb/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=26
[junit4:junit4]   2> 1814089 T5511 C733 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={distrib=false&getUpdates=1439081010246451200,1439081010183536640&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 1814090 T5509 oasc.SyncStrategy.syncToMe http://127.0.0.1:50863/x_avr/bb/collection1/:  sync completed with http://127.0.0.1:50877/x_avr/bb/collection1/
[junit4:junit4]   2> 1814097 T5527 C736 P50866 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1439081010183536640), 3 (1439081010246451200)]} 0 6
[junit4:junit4]   2> 1814098 T5527 C736 P50866 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:50866/x_avr/bb DONE. sync succeeded
[junit4:junit4]   2> 1814099 T5527 C736 P50866 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/get params={sync=http://127.0.0.1:50863/x_avr/bb/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=40
[junit4:junit4]   2> 1814100 T5509 oasc.SyncStrategy.syncToMe http://127.0.0.1:50863/x_avr/bb/collection1/:  sync completed with http://127.0.0.1:50866/x_avr/bb/collection1/
[junit4:junit4]   2> 1814102 T5509 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=71
[junit4:junit4]   2> 1814103 T5541 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2} status=0 QTime=125
[junit4:junit4]   2> 1814104 T5474 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 1814104 T5474 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 1814106 T5474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1814108 T5474 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> 1814112 T5487 C734 P50859 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1814113 T5487 C734 P50859 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 1814114 T5487 C734 P50859 oass.SolrIndexSearcher.<init> Opening Searcher@126f973a main
[junit4:junit4]   2> 1814115 T5487 C734 P50859 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1814116 T5500 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@126f973a main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 1814117 T5487 C734 P50859 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4]   2> 1814122 T5558 C732 P50877 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:50863/x_avr/bb/collection1/, StdNode: http://127.0.0.1:50866/x_avr/bb/collection1/, StdNode: http://127.0.0.1:50870/x_avr/bb/collection1/, StdNode: http://127.0.0.1:50877/x_avr/bb/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 1814133 T5510 C733 P50863 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1814138 T5510 C733 P50863 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 1814142 T5510 C733 P50863 oass.SolrIndexSearcher.<init> Opening Searcher@17e0f51 main
[junit4:junit4]   2> 1814142 T5510 C733 P50863 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1814143 T5523 C736 P50866 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1814145 T5518 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17e0f51 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 1814146 T5559 C732 P50877 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1814146 T5559 C732 P50877 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 1814145 T5544 C735 P50870 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 1814147 T5544 C735 P50870 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4:junit4]   2> 1814148 T5510 C733 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4]   2> 1814149 T5544 C735 P50870 oass.SolrIndexSearcher.<init> Opening Searcher@2f6002c6 main
[junit4:junit4]   2> 1814150 T5544 C735 P50870 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1814155 T5523 C736 P50866 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a0cdad5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@26516c43),segFN=segments_2,generation=2}
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a0cdad5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@26516c43),segFN=segments_3,generation=3}
[junit4:junit4]   2> 1814156 T5523 C736 P50866 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4]   2> 1814157 T5559 C732 P50877 oass.SolrIndexSearcher.<init> Opening Searcher@3d627bff main
[junit4:junit4]   2> 1814158 T5559 C732 P50877 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1814159 T5552 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4]   2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4]   2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4]   2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4]   2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4]   2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4]   2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4:junit4]   2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4]   2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4]   2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:305)
[junit4:junit4]   2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1844)
[junit4:junit4]   2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:135)
[junit4:junit4]   2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1721)
[junit4:junit4]   2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:724)
[junit4:junit4]   2>
[junit4:junit4]   2> 1814159 T5570 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3d627bff main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 1814161 T5559 C732 P50877 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 15
[junit4:junit4]   2> 1814161 T5552 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f6002c6 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C4)}
[junit4:junit4]   2> 1814163 T5544 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4]   2> 1814164 T5523 C736 P50866 oass.SolrIndexSearcher.<init> Opening Searcher@3ed009fc main
[junit4:junit4]   2> 1814165 T5523 C736 P50866 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 1814167 T5534 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ed009fc main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):C2 _1(5.0):C2)}
[junit4:junit4]   2> 1814169 T5523 C736 P50866 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 26
[junit4:junit4]   2> 1814170 T5558 C732 P50877 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 49
[junit4:junit4]   2> 1814173 T5474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1814185 T5507 C733 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4]   2> 1814192 T5528 C736 P50866 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2> 1814197 T5545 C735 P50870 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2> 1814203 T5560 C732 P50877 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2> 1816213 T5474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> check const of shard1
[junit4:junit4]   2> client0
[junit4:junit4]   2> PROPS:core_node1:{"state":"active","core":"collection1","node_name":"127.0.0.1:50863_x_avr%2Fbb","base_url":"http://127.0.0.1:50863/x_avr/bb","leader":"true"}
[junit4:junit4]   2> 1816225 T5507 C733 P50863 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2>
[junit4:junit4]   2> client1
[junit4:junit4]   2> PROPS:core_node2:{"state":"active","core":"collection1","node_name":"127.0.0.1:50866_x_avr%2Fbb","base_url":"http://127.0.0.1:50866/x_avr/bb"}
[junit4:junit4]   2> 1816230 T5528 C736 P50866 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2>
[junit4:junit4]   2> client2
[junit4:junit4]   2> PROPS:core_node3:{"state":"active","core":"collection1","node_name":"127.0.0.1:50870_x_avr%2Fbb","base_url":"http://127.0.0.1:50870/x_avr/bb"}
[junit4:junit4]   2> 1816235 T5545 C735 P50870 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2>
[junit4:junit4]   2> client3
[junit4:junit4]   2> PROPS:core_node4:{"state":"active","core":"collection1","node_name":"127.0.0.1:50877_x_avr%2Fbb","base_url":"http://127.0.0.1:50877/x_avr/bb"}
[junit4:junit4]   2> 1816240 T5560 C732 P50877 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4]   2>  live:true
[junit4:junit4]   2>  num:4
[junit4:junit4]   2>
[junit4:junit4]   2> 1816245 T5524 C736 P50866 oasc.SolrCore.execute [collection1] webapp=/x_avr/bb path=/select params={q=*:*&wt=javabin&version=2} hits=4 status=0 QTime=0
[junit4:junit4]   2> 1816256 T5487 C734 P50859 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={wt=javabin&version=2} {add=[4 (1439081012874182656)]} 0 5
[junit4:junit4]   2> 1816262 T5512 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:50877/x_avr/bb/collection1/]
[junit4:junit4]   2> 1816262 T5512 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50866/x_avr/bb/collection1/ against:[http://127.0.0.1:50877/x_avr/bb/collection1/] result:false
[junit4:junit4]   2> 1816263 T5512 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50870/x_avr/bb/collection1/ against:[http://127.0.0.1:50877/x_avr/bb/collection1/] result:false
[junit4:junit4]   2> 1816264 T5512 C733 P50863 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:50877/x_avr/bb/collection1/ against:[http://127.0.0.1:50877/x_avr/bb/collection1/] result:true
[junit4:junit4]   2> 1816278 T5543 C735 P50870 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50877/x_avr/bb/collection1/&wt=javabin&version=2} {add=[4 (1439081012888862720)]} 0 4
[junit4:junit4]   2> 1816278 T5525 C736 P50866 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={distrib.from=http://127.0.0.1:50863/x_avr/bb/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:50877/x_avr/bb/collection1/&wt=javabin&version=2} {add=[4 (1439081012888862720)]} 0 5
[junit4:junit4]   2> 1816281 T5512 C733 P50863 oasup.LogUpdateProcessor.finish [collection1] webapp=/x_avr/bb path=/update params={test.distrib.skip.servers=http://127.0.0.1:50877/x_avr/bb/collection1/&wt=javabin&version=2} {add=[4 (1439081012888862720)]} 0 20
[junit4:junit4]   2> 1816282 T5474 oasc.ChaosMonkey.monkeyLog monkey: kill shard! 50863
[junit4:junit4]   2> 1816298 T5474 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=271335508
[junit4:junit4]   2> 1817374 T5497 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1817376 T5497 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"core_node1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:50863_x_avr%2Fbb",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50863/x_avr/bb"}
[junit4:junit4]   2> 1817376 T5497 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4:junit4]   2> 1817388 T5496 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1817388 T5516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1817389 T5532 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1817389 T5549 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1817390 T5567 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 1817389