[JENKINS] Lucene-Solr-tests-only-trunk-java7 - Build # 2948 - Failure

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-tests-only-trunk-java7 - Build # 2948 - Failure

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk-java7/2948/

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest

Error Message:
ERROR: SolrIndexSearcher opens=1280 closes=1281

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=1280 closes=1281
        at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)


REGRESSION:  org.apache.solr.cloud.FullSolrCloudTest.testDistribSearch

Error Message:
Shard still reported as live in zk

Stack Trace:
java.lang.AssertionError: Shard still reported as live in zk
        at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94:5308F8B5C5F35FA8]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.FullSolrCloudTest.brindDownShardIndexSomeDocsAndRecover(FullSolrCloudTest.java:712)
        at org.apache.solr.cloud.FullSolrCloudTest.doTest(FullSolrCloudTest.java:556)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SyncSliceTest

Error Message:
ERROR: SolrIndexSearcher opens=36 closes=35

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=36 closes=35
        at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)




Build Log:
[...truncated 12199 lines...]
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 87333 T310 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88014630061211650-127.0.0.1:19878_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 87558 T346 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:19875
[junit4:junit4]   2> 87791 T359 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:19875
[junit4:junit4]   2> 88171 T322 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:19875
[junit4:junit4]   2> 98500 T323 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 98500 T289 oaz.ZooKeeper.close Session: 0x138b0d6f7d60003 closed
[junit4:junit4]   2> 98501 T289 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 98554 T289 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 19882
[junit4:junit4]   2> 98554 T289 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 19886
[junit4:junit4]   2> 98554 T289 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=950896874
[junit4:junit4]   2> 98555 T289 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19886_solr_collection1
[junit4:junit4]   2> 98555 T289 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@58280c62
[junit4:junit4]   2> 98559 T289 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 98560 T289 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=7,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 98562 T289 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19886_solr_collection1
[junit4:junit4]   2> 98664 T347 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 98664 T289 oaz.ZooKeeper.close Session: 0x138b0d6f7d60005 closed
[junit4:junit4]   2> 98665 T289 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 98717 T289 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 19897
[junit4:junit4]   2> 98717 T289 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=65099860
[junit4:junit4]   2> 98717 T289 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19897_solr_collection1
[junit4:junit4]   2> 98819 T289 oaz.ZooKeeper.close Session: 0x138b0d6f7d60006 closed
[junit4:junit4]   2> 98819 T289 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 98962 T289 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/control_shard/election/88014630061211650-127.0.0.1:19878_solr_collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/control_shard (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:19878_solr",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:19878/solr"}
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "shard1":{
[junit4:junit4]   1>             "127.0.0.1:19880_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:19880_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:19880/solr"},
[junit4:junit4]   1>             "127.0.0.1:19886_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:19886_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:19886/solr"}},
[junit4:junit4]   1>           "shard2":{
[junit4:junit4]   1>             "127.0.0.1:19882_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard2",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:19882_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:19882/solr"},
[junit4:junit4]   1>             "127.0.0.1:19897_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard2",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:19897_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:19897/solr"}}},
[junit4:junit4]   1>         "control_collection":{"control_shard":{"127.0.0.1:19878_solr_collection1":{
[junit4:junit4]   1>               "shard":"control_shard",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"control_collection",
[junit4:junit4]   1>               "node_name":"127.0.0.1:19878_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:19878/solr"}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudTest -Dtests.method=testDistribSearch -Dtests.seed=D2EE76ADB2AC3F94 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lv_LV -Dtests.timezone=Asia/Kolkata -Dtests.file.encoding=ISO-8859-1
[junit4:junit4]   1>
[junit4:junit4]   2>
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 99026 T289 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 99913 T360 oasc.SyncStrategy.syncToMe Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:19882/solr/collection1
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncToMe(SyncStrategy.java:237)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:119)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:82)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:158)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to 127.0.0.1:19882 timed out
[junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:125)
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4]   2> ... 11 more
[junit4:junit4]   2>
[junit4:junit4]   2> 99914 T360 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19897_solr_collection1
[junit4:junit4]   2> 99915 T360 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@44f0adaf
[junit4:junit4]   2> 99921 T360 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 99926 T360 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 99927 T360 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19897_solr_collection1
[junit4:junit4]   2> 99927 T360 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:244)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:236)
[junit4:junit4]   2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:734)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:168)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 99928 T360 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 99929 T360 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 99929 T360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26fb554c name:ZooKeeperConnection Watcher:127.0.0.1:19875/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 99929 T360 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=NestedPulsing), foo_b=PostingsFormat(name=Asserting), foo_d=PostingsFormat(name=MockRandom), foo_f=PostingsFormat(name=Asserting), n_tl1=PostingsFormat(name=NestedPulsing), n_d1=PostingsFormat(name=MockSep), rnd_b=PostingsFormat(name=MockRandom), intDefault=PostingsFormat(name=NestedPulsing), n_td1=PostingsFormat(name=NestedPulsing), id=PostingsFormat(name=MockRandom), timestamp=PostingsFormat(name=MockSep), range_facet_sl=PostingsFormat(name=MockRandom), range_facet_si=PostingsFormat(name=MockSep), oddField_s=PostingsFormat(name=MockRandom), multiDefault=PostingsFormat(name=MockSep), n_tf1=PostingsFormat(name=MockSep), n_dt1=PostingsFormat(name=NestedPulsing), n_ti1=PostingsFormat(name=MockRandom), range_facet_l=PostingsFormat(name=MockSep), text=PostingsFormat(name=Asserting), _version_=PostingsFormat(name=NestedPulsing), SubjectTerms_mfacet=PostingsFormat(name=NestedPulsing), a_t=PostingsFormat(name=MockSep), n_tdt1=PostingsFormat(name=NestedPulsing), other_tl1=PostingsFormat(name=NestedPulsing), n_l1=PostingsFormat(name=MockSep), a_si=PostingsFormat(name=NestedPulsing)}, sim=RandomSimilarityProvider(queryNorm=true,coord=false): {}, locale=lv_LV, timezone=Asia/Kolkata
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=1,free=187174504,total=308281344
[junit4:junit4]   2> NOTE: All tests run in this JVM: [JsonLoaderTest, ZkSolrClientTest, LeaderElectionTest, TestJapaneseReadingFormFilterFactory, CircularListTest, CSVRequestHandlerTest, MultiTermTest, SearchHandlerTest, IndexSchemaRuntimeFieldTest, TestUAX29URLEmailTokenizerFactory, RAMDirectoryFactoryTest, TestSolrXMLSerializer, TermVectorComponentTest, SampleTest, TestDocSet, TestRemoteStreaming, TestStressLucene, NotRequiredUniqueKeyTest, CloudStateTest, TestBinaryResponseWriter, TestStopFilterFactory, IndexReaderFactoryTest, TestCJKBigramFilterFactory, TestWriterPerf, TestKeepFilterFactory, TestConfig, TestLMDirichletSimilarityFactory, TestLuceneMatchVersion, ScriptEngineTest, TestGalicianMinimalStemFilterFactory, TestFastLRUCache, TestQuerySenderNoQuery, TestBeiderMorseFilterFactory, IndexSchemaTest, FullSolrCloudTest]
[junit4:junit4]   2>
[junit4:junit4] Completed on J1 in 100.04s, 1 test, 1 failure <<< FAILURES!
[...truncated 147 lines...]
[junit4:junit4]   2> 69290 T2721 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 69290 T2721 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 69291 T2721 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 69291 T2721 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 95069 T2708 oasc.SyncStrategy.syncToMe Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:19900/solr/collection1
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncToMe(SyncStrategy.java:237)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:119)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:82)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:158)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to 127.0.0.1:19900 timed out
[junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:125)
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4]   2> ... 11 more
[junit4:junit4]   2>
[junit4:junit4]   2> 95070 T2708 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19908_solr_collection1
[junit4:junit4]   2> 95070 T2708 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:244)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:236)
[junit4:junit4]   2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:734)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:168)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 95071 T2708 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 95071 T2708 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 95072 T2708 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 95072 T2708 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 95174 T2702 C8 P19908 oasc.SolrException.log SEVERE shard update error StdNode: http://127.0.0.1:19900/solr/collection1/:org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:19900/solr/collection1
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:407)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
[junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:336)
[junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:317)
[junit4:junit4]   2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4:junit4]   2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$BoundedExecutor$1.run(SolrCmdDistributor.java:538)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connection to http://127.0.0.1:19900 refused
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:158)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4]   2> ... 12 more
[junit4:junit4]   2> Caused by: java.net.ConnectException: Operation timed out
[junit4:junit4]   2> at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
[junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
[junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
[junit4:junit4]   2> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
[junit4:junit4]   2> at java.net.Socket.connect(Socket.java:579)
[junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123)
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
[junit4:junit4]   2> ... 20 more
[junit4:junit4]   2>
[junit4:junit4]   2> 160727 T2662 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=36 closes=35
[junit4:junit4]   2> NOTE: test params are: codec=SimpleText, sim=DefaultSimilarity, locale=th_TH_TH_#u-nu-thai, timezone=Pacific/Tongatapu
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=6,free=78040088,total=369098752
[junit4:junit4]   2> NOTE: All tests run in this JVM: [RecoveryZkTest, TestStressRecovery, TestSynonymFilterFactory, FastVectorHighlighterTest, DirectUpdateHandlerOptimizeTest, SolrCmdDistributorTest, SyncSliceTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.seed=D2EE76ADB2AC3F94 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th_TH_TH_#u-nu-thai -Dtests.timezone=Pacific/Tongatapu -Dtests.file.encoding=ISO-8859-1
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | SyncSliceTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=36 closes=35
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 160.80s, 1 test, 1 failure <<< FAILURES!
[...truncated 9 lines...]
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.SpellingQueryConverterTest
[junit4:junit4] Completed on J1 in 0.12s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.DebugComponentTest
[junit4:junit4] Completed on J1 in 1.24s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestJmxMonitoredMap
[junit4:junit4] Completed on J1 in 0.14s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.FieldAnalysisRequestHandlerTest
[junit4:junit4] Completed on J1 in 1.13s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4:junit4] Completed on J1 in 34.01s, 8 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4:junit4] Completed on J1 in 129.87s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4:junit4] Completed on J1 in 32.55s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.DistributedSpellCheckComponentTest
[junit4:junit4] Completed on J1 in 11.38s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestRealTimeGet
[junit4:junit4] Completed on J1 in 10.46s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.ZkControllerTest
[junit4:junit4] Completed on J1 in 7.14s, 3 tests
[junit4:junit4]  
[junit4:junit4] HEARTBEAT J0: 2012-07-22T22:45:30, no events in: 62.2s, approx. at: BasicDistributedZkTest.testDistribSearch
[junit4:junit4] Suite: org.apache.solr.TestDistributedGrouping
[junit4:junit4] Completed on J1 in 16.96s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 225132 T2763 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 225735 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:486)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:431)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:412)
[junit4:junit4]   2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:272)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 225735 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection2/leader_elect/shard1/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 225736 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection3/leader_elect/shard1/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 225737 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_11/leader_elect/shard1/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 225737 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_3/leader_elect/shard1/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 225737 T2809 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 225737 T2809 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 225738 T2809 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 227554 T2766 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 346333 T2763 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=1280 closes=1281
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=Direct), foo_b=PostingsFormat(name=Memory doPackFST= true), cat=PostingsFormat(name=SimpleText), foo_d=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), foo_f=PostingsFormat(name=Memory doPackFST= true), n_tl1=PostingsFormat(name=Direct), n_d1=PostingsFormat(name=SimpleText), rnd_b=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), intDefault=PostingsFormat(name=Direct), n_td1=PostingsFormat(name=Direct), id=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), timestamp=PostingsFormat(name=Direct), range_facet_sl=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), range_facet_si=PostingsFormat(name=SimpleText), oddField_s=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), sequence_i=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), name=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), foo_i=PostingsFormat(name=Direct), regex_dup_B_s=PostingsFormat(name=Direct), multiDefault=PostingsFormat(name=Direct), n_tf1=PostingsFormat(name=SimpleText), n_dt1=PostingsFormat(name=Direct), genre_s=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), author_t=PostingsFormat(name=Direct), n_ti1=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), range_facet_l=PostingsFormat(name=Direct), text=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=Direct), val_i=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), SubjectTerms_mfacet=PostingsFormat(name=Direct), series_t=PostingsFormat(name=Direct), a_t=PostingsFormat(name=SimpleText), n_tdt1=PostingsFormat(name=Direct), regex_dup_A_s=PostingsFormat(name=Memory doPackFST= true), price=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Direct), n_l1=PostingsFormat(name=SimpleText), a_si=PostingsFormat(name=Direct), inStock=PostingsFormat(name=Memory doPackFST= true)}, sim=DefaultSimilarity, locale=en_IN, timezone=Atlantic/Canary
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=2,free=55622912,total=379584512
[junit4:junit4]   2> NOTE: All tests run in this JVM: [RecoveryZkTest, TestStressRecovery, TestSynonymFilterFactory, FastVectorHighlighterTest, DirectUpdateHandlerOptimizeTest, SolrCmdDistributorTest, SyncSliceTest, TestCodecSupport, BasicDistributedZkTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.seed=D2EE76ADB2AC3F94 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_IN -Dtests.timezone=Atlantic/Canary -Dtests.file.encoding=ISO-8859-1
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | BasicDistributedZkTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=1280 closes=1281
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 346.35s, 1 test, 1 failure <<< FAILURES!
[...truncated 647 lines...]

[...truncated 13455 lines...]

[...truncated 13455 lines...]

[...truncated 13455 lines...]

[...truncated 13455 lines...]

[...truncated 12612 lines...]
[junit4:junit4]   2> 160727 T2662 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=36 closes=35
[junit4:junit4]   2> NOTE: test params are: codec=SimpleText, sim=DefaultSimilarity, locale=th_TH_TH_#u-nu-thai, timezone=Pacific/Tongatapu
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=6,free=78040088,total=369098752
[junit4:junit4]   2> NOTE: All tests run in this JVM: [RecoveryZkTest, TestStressRecovery, TestSynonymFilterFactory, FastVectorHighlighterTest, DirectUpdateHandlerOptimizeTest, SolrCmdDistributorTest, SyncSliceTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.seed=D2EE76ADB2AC3F94 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th_TH_TH_#u-nu-thai -Dtests.timezone=Pacific/Tongatapu -Dtests.file.encoding=ISO-8859-1
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | SyncSliceTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=36 closes=35
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 160.80s, 1 test, 1 failure <<< FAILURES!
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestCodecSupport
[junit4:junit4] Completed on J0 in 0.26s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.function.distance.DistanceFunctionTest
[junit4:junit4] Completed on J1 in 1.28s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.TestMultiCoreConfBootstrap
[junit4:junit4] Completed on J1 in 2.52s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.SpellingQueryConverterTest
[junit4:junit4] Completed on J1 in 0.12s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.DebugComponentTest
[junit4:junit4] Completed on J1 in 1.24s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestJmxMonitoredMap
[junit4:junit4] Completed on J1 in 0.14s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.FieldAnalysisRequestHandlerTest
[junit4:junit4] Completed on J1 in 1.13s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4:junit4] Completed on J1 in 34.01s, 8 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4:junit4] Completed on J1 in 129.87s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4:junit4] Completed on J1 in 32.55s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.DistributedSpellCheckComponentTest
[junit4:junit4] Completed on J1 in 11.38s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestRealTimeGet
[junit4:junit4] Completed on J1 in 10.46s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.ZkControllerTest
[junit4:junit4] Completed on J1 in 7.14s, 3 tests
[junit4:junit4]  
[junit4:junit4] HEARTBEAT J0: 2012-07-22T22:45:30, no events in: 62.2s, approx. at: BasicDistributedZkTest.testDistribSearch
[junit4:junit4] Suite: org.apache.solr.TestDistributedGrouping
[junit4:junit4] Completed on J1 in 16.96s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 225132 T2763 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 225735 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:486)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:431)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:412)
[junit4:junit4]   2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:272)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 225735 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection2/leader_elect/shard1/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 225736 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection3/leader_elect/shard1/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 225737 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_11/leader_elect/shard1/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 225737 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_3/leader_elect/shard1/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 225737 T2809 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 225737 T2809 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 225738 T2809 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 227554 T2766 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 346333 T2763 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=1280 closes=1281
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=Direct), foo_b=PostingsFormat(name=Memory doPackFST= true), cat=PostingsFormat(name=SimpleText), foo_d=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), foo_f=PostingsFormat(name=Memory doPackFST= true), n_tl1=PostingsFormat(name=Direct), n_d1=PostingsFormat(name=SimpleText), rnd_b=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), intDefault=PostingsFormat(name=Direct), n_td1=PostingsFormat(name=Direct), id=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), timestamp=PostingsFormat(name=Direct), range_facet_sl=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), range_facet_si=PostingsFormat(name=SimpleText), oddField_s=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), sequence_i=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), name=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), foo_i=PostingsFormat(name=Direct), regex_dup_B_s=PostingsFormat(name=Direct), multiDefault=PostingsFormat(name=Direct), n_tf1=PostingsFormat(name=SimpleText), n_dt1=PostingsFormat(name=Direct), genre_s=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), author_t=PostingsFormat(name=Direct), n_ti1=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), range_facet_l=PostingsFormat(name=Direct), text=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=Direct), val_i=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), SubjectTerms_mfacet=PostingsFormat(name=Direct), series_t=PostingsFormat(name=Direct), a_t=PostingsFormat(name=SimpleText), n_tdt1=PostingsFormat(name=Direct), regex_dup_A_s=PostingsFormat(name=Memory doPackFST= true), price=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Direct), n_l1=PostingsFormat(name=SimpleText), a_si=PostingsFormat(name=Direct), inStock=PostingsFormat(name=Memory doPackFST= true)}, sim=DefaultSimilarity, locale=en_IN, timezone=Atlantic/Canary
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=2,free=55622912,total=379584512
[junit4:junit4]   2> NOTE: All tests run in this JVM: [RecoveryZkTest, TestStressRecovery, TestSynonymFilterFactory, FastVectorHighlighterTest, DirectUpdateHandlerOptimizeTest, SolrCmdDistributorTest, SyncSliceTest, TestCodecSupport, BasicDistributedZkTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.seed=D2EE76ADB2AC3F94 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_IN -Dtests.timezone=Atlantic/Canary -Dtests.file.encoding=ISO-8859-1
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | BasicDistributedZkTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=1280 closes=1281
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 346.35s, 1 test, 1 failure <<< FAILURES!
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPatternTokenizerFactory
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.admin.LukeRequestHandlerTest
[junit4:junit4] Completed on J0 in 2.40s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSolrQueryParser
[junit4:junit4] Completed on J0 in 0.71s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSolrJ
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestFrenchMinimalStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestStandardFactories
[junit4:junit4] Completed on J0 in 0.06s, 10 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.TestIndexingPerformance
[junit4:junit4] Completed on J0 in 0.76s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapanesePartOfSpeechStopFilterFactory
[junit4:junit4] Completed on J0 in 0.26s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestDictionaryCompoundWordTokenFilterFactory
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.servlet.SolrRequestParserTest
[junit4:junit4] Completed on J0 in 1.18s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.SolrCoreCheckLockOnStartupTest
[junit4:junit4] Completed on J0 in 1.33s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.SimpleFacetsTest
[junit4:junit4] Completed on J0 in 6.45s, 30 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestFinnishLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestBulgarianStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestBadConfig
[junit4:junit4] Completed on J0 in 2.12s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.DoubleMetaphoneFilterFactoryTest
[junit4:junit4] Completed on J0 in 0.10s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestPropInject
[junit4:junit4] Completed on J0 in 1.31s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestReversedWildcardFilterFactory
[junit4:junit4] Completed on J0 in 0.96s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestGermanStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestGalicianStemFilterFactory
[junit4:junit4] Completed on J0 in 0.03s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestIrishLowerCaseFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.OutputWriterTest
[junit4:junit4] Completed on J0 in 0.43s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestRandomFaceting
[junit4:junit4] Completed on J1 in 85.61s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.SoftAutoCommitTest
[junit4:junit4] Completed on J1 in 10.67s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.AutoCommitTest
[junit4:junit4] Completed on J1 in 9.43s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.TestFaceting
[junit4:junit4] Completed on J1 in 10.70s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.WordBreakSolrSpellCheckerTest
[junit4:junit4] Completed on J1 in 1.25s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestStressVersions
[junit4:junit4] Completed on J0 in 11.07s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestBrazilianStemFilterFactory
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.StatsComponentTest
[junit4:junit4] Completed on J0 in 6.06s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.TestHashPartitioner
[junit4:junit4] Completed on J1 in 8.53s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestRecovery
[junit4:junit4] Completed on J1 in 10.64s, 9 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.SolrCoreTest
[junit4:junit4] Completed on J1 in 6.75s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.IndexBasedSpellCheckerTest
[junit4:junit4] Completed on J1 in 1.30s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.DirectUpdateHandlerTest
[junit4:junit4] Completed on J1 in 3.27s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestCoreContainer
[junit4:junit4] Completed on J1 in 3.36s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSort
[junit4:junit4] Completed on J1 in 5.38s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestDistributedSearch
[junit4:junit4] Completed on J0 in 95.36s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestLFUCache
[junit4:junit4] Completed on J0 in 0.72s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.CommonGramsQueryFilterFactoryTest
[junit4:junit4] Completed on J0 in 0.03s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestJmxIntegration
[junit4:junit4] IGNORED 0.00s J0 | TestJmxIntegration.testJmxOnCoreReload
[junit4:junit4]    > Cause: Annotated @Ignore(timing problem? https://issues.apache.org/jira/browse/SOLR-2715)
[junit4:junit4] Completed on J0 in 1.47s, 3 tests, 1 skipped
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.SpatialFilterTest
[junit4:junit4] Completed on J0 in 1.45s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.CSVStrategyTest
[junit4:junit4] Completed on J0 in 0.02s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPhoneticFilterFactory
[junit4:junit4] Completed on J0 in 9.67s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestQueryUtils
[junit4:junit4] Completed on J0 in 1.33s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.ZkNodePropsTest
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.BadComponentTest
[junit4:junit4] Completed on J0 in 0.60s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.FileUtilsTest
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestGroupingSearch
[junit4:junit4] Completed on J1 in 17.11s, 12 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.DirectSolrSpellCheckerTest
[junit4:junit4] Completed on J1 in 1.39s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.PeerSyncTest
[junit4:junit4] Completed on J1 in 4.26s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestExtendedDismaxParser
[junit4:junit4] Completed on J0 in 8.96s, 10 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.SOLR749Test
[junit4:junit4] Completed on J0 in 0.96s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestArabicFilters
[junit4:junit4] Completed on J0 in 0.03s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.function.SortByFunctionTest
[junit4:junit4] Completed on J1 in 1.92s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestIndexSearcher
[junit4:junit4] Completed on J1 in 1.84s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.QueryElevationComponentTest
[junit4:junit4] Completed on J0 in 4.83s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestSwedishLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestNorwegianLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestItalianLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.function.TestFunctionQuery
[junit4:junit4] Completed on J1 in 2.78s, 14 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.admin.CoreAdminHandlerTest
[junit4:junit4] Completed on J0 in 1.50s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestTrie
[junit4:junit4] Completed on J1 in 2.02s, 8 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.servlet.DirectSolrConnectionTest
[junit4:junit4] Completed on J1 in 0.53s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.AnalysisAfterCoreReloadTest
[junit4:junit4] Completed on J0 in 2.80s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestRemoveDuplicatesTokenFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.DOMUtilTest
[junit4:junit4] Completed on J0 in 0.06s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.MoreLikeThisHandlerTest
[junit4:junit4] Completed on J0 in 0.93s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.servlet.CacheHeaderTest
[junit4:junit4] Completed on J1 in 1.25s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.QueryEqualityTest
[junit4:junit4] Completed on J1 in 1.20s, 58 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestWordDelimiterFilterFactory
[junit4:junit4] Completed on J1 in 1.34s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.ConvertedLegacyTest
[junit4:junit4] Completed on J0 in 2.99s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.LegacyHTMLStripCharFilterTest
[junit4:junit4] IGNORED 0.00s J0 | LegacyHTMLStripCharFilterTest.testRandom
[junit4:junit4]    > Cause: Annotated @Ignore(broken offsets: see LUCENE-2208)
[junit4:junit4] Completed on J0 in 0.15s, 13 tests, 1 skipped
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestPerFieldSimilarity
[junit4:junit4] Completed on J0 in 0.23s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.TestCSVLoader
[junit4:junit4] Completed on J1 in 1.49s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.PolyFieldTest
[junit4:junit4] Completed on J1 in 1.63s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.response.TestCSVResponseWriter
[junit4:junit4] Completed on J1 in 0.99s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.DistributedQueryElevationComponentTest
[junit4:junit4] Completed on J1 in 2.11s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.CurrencyFieldTest
[junit4:junit4] IGNORED 0.00s J1 | CurrencyFieldTest.testPerformance
[junit4:junit4]    > Cause: Annotated @Ignore()
[junit4:junit4] Completed on J1 in 1.40s, 8 tests, 1 skipped
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.BinaryUpdateRequestHandlerTest
[junit4:junit4] Completed on J1 in 0.92s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.QueryParsingTest
[junit4:junit4] Completed on J1 in 0.89s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.TermsComponentTest
[junit4:junit4] Completed on J1 in 1.06s, 13 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.SolrInfoMBeanTest
[junit4:junit4] Completed on J1 in 1.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.MinimalSchemaTest
[junit4:junit4] Completed on J1 in 0.72s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.StandardRequestHandlerTest
[junit4:junit4] Completed on J1 in 1.16s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestQueryTypes
[junit4:junit4] Completed on J1 in 1.03s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.response.TestPHPSerializedResponseWriter
[junit4:junit4] Completed on J1 in 1.06s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.XmlUpdateRequestHandlerTest
[junit4:junit4] Completed on J1 in 0.98s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.PingRequestHandlerTest
[junit4:junit4] Completed on J1 in 1.17s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterWFSTTest
[junit4:junit4] Completed on J1 in 1.30s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestValueSourceCache
[junit4:junit4] Completed on J1 in 1.05s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.JSONWriterTest
[junit4:junit4] Completed on J1 in 1.01s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.ReturnFieldsTest
[junit4:junit4] Completed on J1 in 1.04s, 10 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.RequestHandlersTest
[junit4:junit4] Completed on J1 in 0.81s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.RequiredFieldsTest
[junit4:junit4] Completed on J1 in 0.64s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterFSTTest
[junit4:junit4] Completed on J1 in 1.66s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.LeaderElectionIntegrationTest
[junit4:junit4] Completed on J0 in 29.26s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.CopyFieldTest
[junit4:junit4] Completed on J1 in 0.79s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterTSTTest
[junit4:junit4] Completed on J1 in 1.63s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.processor.UniqFieldsUpdateProcessorFactoryTest
[junit4:junit4] Completed on J1 in 0.76s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.UpdateParamsTest
[junit4:junit4] Completed on J1 in 0.77s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterTest
[junit4:junit4] Completed on J1 in 1.37s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.admin.ShowFileRequestHandlerTest
[junit4:junit4] Completed on J1 in 0.99s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSearchPerf
[junit4:junit4] Completed on J1 in 0.42s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.BadIndexSchemaTest
[junit4:junit4] Completed on J1 in 1.62s, 9 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestFoldingMultitermQuery
[junit4:junit4] Completed on J1 in 1.20s, 18 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest
[junit4:junit4] Completed on J1 in 1.30s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.servlet.NoCacheHeaderTest
[junit4:junit4] Completed on J1 in 0.86s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.PrimitiveFieldTypeTest
[junit4:junit4] Completed on J1 in 1.09s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.AlternateDirectoryTest
[junit4:junit4] Completed on J1 in 0.70s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.TestUpdate
[junit4:junit4] Completed on J1 in 0.83s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.TestBinaryField
[junit4:junit4] Completed on J1 in 0.33s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.highlight.HighlighterConfigTest
[junit4:junit4] Completed on J1 in 0.83s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestSolrDeletionPolicy2
[junit4:junit4] Completed on J1 in 0.68s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestPropInjectDefaults
[junit4:junit4] Completed on J1 in 0.68s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.processor.DefaultValueUpdateProcessorTest
[junit4:junit4] Completed on J1 in 0.61s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestXIncludeConfig
[junit4:junit4] Completed on J1 in 0.70s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestQuerySenderListener
[junit4:junit4] Completed on J1 in 0.96s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.SolrIndexConfigTest
[junit4:junit4] Completed on J1 in 0.89s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.NumericFieldsTest
[junit4:junit4] Completed on J1 in 0.47s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.TestNumberUtils
[junit4:junit4] Completed on J1 in 0.16s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapaneseKatakanaStemFilterFactory
[junit4:junit4] Completed on J1 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestSolrCoreProperties
[junit4:junit4] Completed on J1 in 0.23s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.EchoParamsTest
[junit4:junit4] Completed on J1 in 0.16s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapaneseTokenizerFactory
[junit4:junit4] Completed on J1 in 0.04s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestKStemFilterFactory
[junit4:junit4] Completed on J1 in 0.14s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestBM25SimilarityFactory
[junit4:junit4] Completed on J1 in 0.14s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.TestPhraseSuggestions
[junit4:junit4] Completed on J1 in 0.16s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestPluginEnable
[junit4:junit4] Completed on J1 in 0.13s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestHyphenationCompoundWordTokenFilterFactory
[junit4:junit4] Completed on J1 in 0.09s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestDFRSimilarityFactory
[junit4:junit4] Completed on J1 in 0.16s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestIBSimilarityFactory
[junit4:junit4] Completed on J1 in 0.16s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestDefaultSimilarityFactory
[junit4:junit4] Completed on J1 in 0.19s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestHTMLStripCharFilterFactory
[junit4:junit4] Completed on J1 in 0.03s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestThaiWordFilterFactory
[junit4:junit4] Completed on J1 in 0.04s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.PluginInfoTest
[junit4:junit4] Completed on J1 in 0.07s, 9 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestShingleFilterFactory
[junit4:junit4] Completed on J1 in 0.05s, 13 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.PrimUtilsTest
[junit4:junit4] Completed on J1 in 0.03s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestNGramFilters
[junit4:junit4] Completed on J1 in 0.04s, 10 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestMultiWordSynonyms
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.OpenExchangeRatesOrgProviderTest
[junit4:junit4] Completed on J1 in 0.06s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestCapitalizationFilterFactory
[junit4:junit4] Completed on J1 in 0.04s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestCzechStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.ResourceLoaderTest
[junit4:junit4] Completed on J1 in 0.04s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.TestSystemIdResolver
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPortugueseMinimalStemFilterFactory
[junit4:junit4] Completed on J1 in 0.03s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestDelimitedPayloadTokenFilterFactory
[junit4:junit4] Completed on J1 in 0.02s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.DateFieldTest
[junit4:junit4] IGNORED 0.00s J1 | DateFieldTest.testRoundTripNonPositiveYear
[junit4:junit4]    > Cause: Annotated @Ignore(SOLR-2773: Non-Positive years don't work)
[junit4:junit4] Completed on J1 in 0.04s, 8 tests, 1 skipped
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPortugueseStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.TestSuggestSpellingConverter
[junit4:junit4] Completed on J1 in 0.01s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestGermanLightStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPersianNormalizationFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.CSVParserTest
[junit4:junit4] Completed on J1 in 0.09s, 23 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.ExtendedBufferedReaderTest
[junit4:junit4] Completed on J1 in 0.01s, 8 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestElisionFilterFactory
[...truncated 162 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/build.xml:29: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build.xml:144: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/module-build.xml:62: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:1094: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:789: There were test failures: 297 suites, 1054 tests, 2 suite-level errors, 1 failure, 5 ignored

Total time: 28 minutes 11 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: [JENKINS] Lucene-Solr-tests-only-trunk-java7 - Build # 2948 - Failure

Mark Miller-3
I'm looking into this.

On Jul 22, 2012, at 6:52 PM, Apache Jenkins Server wrote:

> Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk-java7/2948/
>
> 3 tests failed.
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest
>
> Error Message:
> ERROR: SolrIndexSearcher opens=1280 closes=1281
>
> Stack Trace:
> java.lang.AssertionError: ERROR: SolrIndexSearcher opens=1280 closes=1281
> at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
> at org.junit.Assert.fail(Assert.java:93)
> at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
> at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
> at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
>
>
> REGRESSION:  org.apache.solr.cloud.FullSolrCloudTest.testDistribSearch
>
> Error Message:
> Shard still reported as live in zk
>
> Stack Trace:
> java.lang.AssertionError: Shard still reported as live in zk
> at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94:5308F8B5C5F35FA8]:0)
> at org.junit.Assert.fail(Assert.java:93)
> at org.apache.solr.cloud.FullSolrCloudTest.brindDownShardIndexSomeDocsAndRecover(FullSolrCloudTest.java:712)
> at org.apache.solr.cloud.FullSolrCloudTest.doTest(FullSolrCloudTest.java:556)
> at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
> at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
>
>
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SyncSliceTest
>
> Error Message:
> ERROR: SolrIndexSearcher opens=36 closes=35
>
> Stack Trace:
> java.lang.AssertionError: ERROR: SolrIndexSearcher opens=36 closes=35
> at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
> at org.junit.Assert.fail(Assert.java:93)
> at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
> at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
> at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
> at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
>
>
>
>
> Build Log:
> [...truncated 12199 lines...]
> [junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
> [junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 87333 T310 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88014630061211650-127.0.0.1:19878_solr-n_0000000000) am no longer a leader.
> [junit4:junit4]   2> 87558 T346 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:19875
> [junit4:junit4]   2> 87791 T359 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:19875
> [junit4:junit4]   2> 88171 T322 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:19875
> [junit4:junit4]   2> 98500 T323 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 98500 T289 oaz.ZooKeeper.close Session: 0x138b0d6f7d60003 closed
> [junit4:junit4]   2> 98501 T289 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
> [junit4:junit4]   2> 98554 T289 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 19882
> [junit4:junit4]   2> 98554 T289 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 19886
> [junit4:junit4]   2> 98554 T289 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=950896874
> [junit4:junit4]   2> 98555 T289 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19886_solr_collection1
> [junit4:junit4]   2> 98555 T289 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@58280c62
> [junit4:junit4]   2> 98559 T289 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
> [junit4:junit4]   2> 98560 T289 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=7,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   2> 98562 T289 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19886_solr_collection1
> [junit4:junit4]   2> 98664 T347 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 98664 T289 oaz.ZooKeeper.close Session: 0x138b0d6f7d60005 closed
> [junit4:junit4]   2> 98665 T289 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
> [junit4:junit4]   2> 98717 T289 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 19897
> [junit4:junit4]   2> 98717 T289 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=65099860
> [junit4:junit4]   2> 98717 T289 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19897_solr_collection1
> [junit4:junit4]   2> 98819 T289 oaz.ZooKeeper.close Session: 0x138b0d6f7d60006 closed
> [junit4:junit4]   2> 98819 T289 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
> [junit4:junit4]   2> 98962 T289 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
> [junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/control_shard/election/88014630061211650-127.0.0.1:19878_solr_collection1-n_0000000000 (0)
> [junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
> [junit4:junit4]   1>      /solr/collections/control_collection/leaders/control_shard (0)
> [junit4:junit4]   1>      DATA:
> [junit4:junit4]   1>          {
> [junit4:junit4]   1>            "core":"collection1",
> [junit4:junit4]   1>            "node_name":"127.0.0.1:19878_solr",
> [junit4:junit4]   1>            "base_url":"http://127.0.0.1:19878/solr"}
> [junit4:junit4]   1>   /solr/clusterstate.json (0)
> [junit4:junit4]   1>   DATA:
> [junit4:junit4]   1>       {
> [junit4:junit4]   1>         "collection1":{
> [junit4:junit4]   1>           "shard1":{
> [junit4:junit4]   1>             "127.0.0.1:19880_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard1",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "leader":"true",
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:19880_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:19880/solr"},
> [junit4:junit4]   1>             "127.0.0.1:19886_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard1",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:19886_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:19886/solr"}},
> [junit4:junit4]   1>           "shard2":{
> [junit4:junit4]   1>             "127.0.0.1:19882_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard2",
> [junit4:junit4]   1>               "leader":"true",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:19882_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:19882/solr"},
> [junit4:junit4]   1>             "127.0.0.1:19897_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard2",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:19897_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:19897/solr"}}},
> [junit4:junit4]   1>         "control_collection":{"control_shard":{"127.0.0.1:19878_solr_collection1":{
> [junit4:junit4]   1>               "shard":"control_shard",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "leader":"true",
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"control_collection",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:19878_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:19878/solr"}}}}
> [junit4:junit4]   1>  /zookeeper (1)
> [junit4:junit4]   1>  DATA:
> [junit4:junit4]   1>      
> [junit4:junit4]   1>
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudTest -Dtests.method=testDistribSearch -Dtests.seed=D2EE76ADB2AC3F94 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lv_LV -Dtests.timezone=Asia/Kolkata -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4]   1>
> [junit4:junit4]   2>
> [junit4:junit4]    > (@AfterClass output)
> [junit4:junit4]   2> 99026 T289 oas.SolrTestCaseJ4.deleteCore ###deleteCore
> [junit4:junit4]   2> 99913 T360 oasc.SyncStrategy.syncToMe Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:19882/solr/collection1
> [junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414)
> [junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
> [junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncToMe(SyncStrategy.java:237)
> [junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:119)
> [junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:82)
> [junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:158)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2> Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to 127.0.0.1:19882 timed out
> [junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:125)
> [junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
> [junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
> [junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
> [junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
> [junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
> [junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
> [junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
> [junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
> [junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
> [junit4:junit4]   2> ... 11 more
> [junit4:junit4]   2>
> [junit4:junit4]   2> 99914 T360 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19897_solr_collection1
> [junit4:junit4]   2> 99915 T360 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@44f0adaf
> [junit4:junit4]   2> 99921 T360 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
> [junit4:junit4]   2> 99926 T360 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   2> 99927 T360 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19897_solr_collection1
> [junit4:junit4]   2> 99927 T360 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:244)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:241)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:241)
> [junit4:junit4]   2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:236)
> [junit4:junit4]   2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:734)
> [junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:168)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 99928 T360 oascc.ZkStateReader$3.process Updating live nodes
> [junit4:junit4]   2> 99929 T360 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4]   2> 99929 T360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26fb554c name:ZooKeeperConnection Watcher:127.0.0.1:19875/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
> [junit4:junit4]   2> 99929 T360 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=NestedPulsing), foo_b=PostingsFormat(name=Asserting), foo_d=PostingsFormat(name=MockRandom), foo_f=PostingsFormat(name=Asserting), n_tl1=PostingsFormat(name=NestedPulsing), n_d1=PostingsFormat(name=MockSep), rnd_b=PostingsFormat(name=MockRandom), intDefault=PostingsFormat(name=NestedPulsing), n_td1=PostingsFormat(name=NestedPulsing), id=PostingsFormat(name=MockRandom), timestamp=PostingsFormat(name=MockSep), range_facet_sl=PostingsFormat(name=MockRandom), range_facet_si=PostingsFormat(name=MockSep), oddField_s=PostingsFormat(name=MockRandom), multiDefault=PostingsFormat(name=MockSep), n_tf1=PostingsFormat(name=MockSep), n_dt1=PostingsFormat(name=NestedPulsing), n_ti1=PostingsFormat(name=MockRandom), range_facet_l=PostingsFormat(name=MockSep), text=PostingsFormat(name=Asserting), _version_=PostingsFormat(name=NestedPulsing), SubjectTerms_mfacet=PostingsFormat(name=NestedPulsing), a_t=PostingsFormat(name=MockSep), n_tdt1=PostingsFormat(name=NestedPulsing), other_tl1=PostingsFormat(name=NestedPulsing), n_l1=PostingsFormat(name=MockSep), a_si=PostingsFormat(name=NestedPulsing)}, sim=RandomSimilarityProvider(queryNorm=true,coord=false): {}, locale=lv_LV, timezone=Asia/Kolkata
> [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=1,free=187174504,total=308281344
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [JsonLoaderTest, ZkSolrClientTest, LeaderElectionTest, TestJapaneseReadingFormFilterFactory, CircularListTest, CSVRequestHandlerTest, MultiTermTest, SearchHandlerTest, IndexSchemaRuntimeFieldTest, TestUAX29URLEmailTokenizerFactory, RAMDirectoryFactoryTest, TestSolrXMLSerializer, TermVectorComponentTest, SampleTest, TestDocSet, TestRemoteStreaming, TestStressLucene, NotRequiredUniqueKeyTest, CloudStateTest, TestBinaryResponseWriter, TestStopFilterFactory, IndexReaderFactoryTest, TestCJKBigramFilterFactory, TestWriterPerf, TestKeepFilterFactory, TestConfig, TestLMDirichletSimilarityFactory, TestLuceneMatchVersion, ScriptEngineTest, TestGalicianMinimalStemFilterFactory, TestFastLRUCache, TestQuerySenderNoQuery, TestBeiderMorseFilterFactory, IndexSchemaTest, FullSolrCloudTest]
> [junit4:junit4]   2>
> [junit4:junit4] Completed on J1 in 100.04s, 1 test, 1 failure <<< FAILURES!
> [...truncated 147 lines...]
> [junit4:junit4]   2> 69290 T2721 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 69290 T2721 oascc.ZkStateReader$3.process Updating live nodes
> [junit4:junit4]   2> 69291 T2721 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4]   2> 69291 T2721 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 95069 T2708 oasc.SyncStrategy.syncToMe Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:19900/solr/collection1
> [junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414)
> [junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
> [junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncToMe(SyncStrategy.java:237)
> [junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:119)
> [junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:82)
> [junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:158)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2> Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to 127.0.0.1:19900 timed out
> [junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:125)
> [junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
> [junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
> [junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
> [junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
> [junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
> [junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
> [junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
> [junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
> [junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
> [junit4:junit4]   2> ... 11 more
> [junit4:junit4]   2>
> [junit4:junit4]   2> 95070 T2708 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:19908_solr_collection1
> [junit4:junit4]   2> 95070 T2708 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:244)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:241)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:241)
> [junit4:junit4]   2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:236)
> [junit4:junit4]   2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:734)
> [junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:168)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 95071 T2708 oascc.ZkStateReader$3.process Updating live nodes
> [junit4:junit4]   2> 95071 T2708 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4]   2> 95072 T2708 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 95072 T2708 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 95174 T2702 C8 P19908 oasc.SolrException.log SEVERE shard update error StdNode: http://127.0.0.1:19900/solr/collection1/:org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:19900/solr/collection1
> [junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:407)
> [junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
> [junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:336)
> [junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:317)
> [junit4:junit4]   2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> [junit4:junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> [junit4:junit4]   2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> [junit4:junit4]   2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> [junit4:junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> [junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$BoundedExecutor$1.run(SolrCmdDistributor.java:538)
> [junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> [junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> [junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connection to http://127.0.0.1:19900 refused
> [junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:158)
> [junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
> [junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
> [junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
> [junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
> [junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
> [junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
> [junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
> [junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
> [junit4:junit4]   2> ... 12 more
> [junit4:junit4]   2> Caused by: java.net.ConnectException: Operation timed out
> [junit4:junit4]   2> at java.net.PlainSocketImpl.socketConnect(Native Method)
> [junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
> [junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
> [junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
> [junit4:junit4]   2> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
> [junit4:junit4]   2> at java.net.Socket.connect(Socket.java:579)
> [junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123)
> [junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
> [junit4:junit4]   2> ... 20 more
> [junit4:junit4]   2>
> [junit4:junit4]   2> 160727 T2662 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=36 closes=35
> [junit4:junit4]   2> NOTE: test params are: codec=SimpleText, sim=DefaultSimilarity, locale=th_TH_TH_#u-nu-thai, timezone=Pacific/Tongatapu
> [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=6,free=78040088,total=369098752
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [RecoveryZkTest, TestStressRecovery, TestSynonymFilterFactory, FastVectorHighlighterTest, DirectUpdateHandlerOptimizeTest, SolrCmdDistributorTest, SyncSliceTest]
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.seed=D2EE76ADB2AC3F94 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th_TH_TH_#u-nu-thai -Dtests.timezone=Pacific/Tongatapu -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4]   2>
> [junit4:junit4] ERROR   0.00s J0 | SyncSliceTest (suite)
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=36 closes=35
> [junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
> [junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
> [junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
> [junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
> [junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> [junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
> [junit4:junit4]    >
> [junit4:junit4] Completed on J0 in 160.80s, 1 test, 1 failure <<< FAILURES!
> [...truncated 9 lines...]
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.spelling.SpellingQueryConverterTest
> [junit4:junit4] Completed on J1 in 0.12s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.component.DebugComponentTest
> [junit4:junit4] Completed on J1 in 1.24s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.TestJmxMonitoredMap
> [junit4:junit4] Completed on J1 in 0.14s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.FieldAnalysisRequestHandlerTest
> [junit4:junit4] Completed on J1 in 1.13s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.OverseerTest
> [junit4:junit4] Completed on J1 in 34.01s, 8 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
> [junit4:junit4] Completed on J1 in 129.87s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.TestReplicationHandler
> [junit4:junit4] Completed on J1 in 32.55s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.component.DistributedSpellCheckComponentTest
> [junit4:junit4] Completed on J1 in 11.38s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestRealTimeGet
> [junit4:junit4] Completed on J1 in 10.46s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.ZkControllerTest
> [junit4:junit4] Completed on J1 in 7.14s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] HEARTBEAT J0: 2012-07-22T22:45:30, no events in: 62.2s, approx. at: BasicDistributedZkTest.testDistribSearch
> [junit4:junit4] Suite: org.apache.solr.TestDistributedGrouping
> [junit4:junit4] Completed on J1 in 16.96s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
> [junit4:junit4]    > (@AfterClass output)
> [junit4:junit4]   2> 225132 T2763 oas.SolrTestCaseJ4.deleteCore ###deleteCore
> [junit4:junit4]   2> 225735 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:486)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:431)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:412)
> [junit4:junit4]   2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:272)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 225735 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection2/leader_elect/shard1/election
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 225736 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection3/leader_elect/shard1/election
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 225737 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_11/leader_elect/shard1/election
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 225737 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_3/leader_elect/shard1/election
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 225737 T2809 oascc.ZkStateReader$3.process Updating live nodes
> [junit4:junit4]   2> 225737 T2809 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4]   2> 225738 T2809 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 227554 T2766 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
> [junit4:junit4]   2> 346333 T2763 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=1280 closes=1281
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=Direct), foo_b=PostingsFormat(name=Memory doPackFST= true), cat=PostingsFormat(name=SimpleText), foo_d=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), foo_f=PostingsFormat(name=Memory doPackFST= true), n_tl1=PostingsFormat(name=Direct), n_d1=PostingsFormat(name=SimpleText), rnd_b=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), intDefault=PostingsFormat(name=Direct), n_td1=PostingsFormat(name=Direct), id=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), timestamp=PostingsFormat(name=Direct), range_facet_sl=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), range_facet_si=PostingsFormat(name=SimpleText), oddField_s=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), sequence_i=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), name=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), foo_i=PostingsFormat(name=Direct), regex_dup_B_s=PostingsFormat(name=Direct), multiDefault=PostingsFormat(name=Direct), n_tf1=PostingsFormat(name=SimpleText), n_dt1=PostingsFormat(name=Direct), genre_s=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), author_t=PostingsFormat(name=Direct), n_ti1=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), range_facet_l=PostingsFormat(name=Direct), text=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=Direct), val_i=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), SubjectTerms_mfacet=PostingsFormat(name=Direct), series_t=PostingsFormat(name=Direct), a_t=PostingsFormat(name=SimpleText), n_tdt1=PostingsFormat(name=Direct), regex_dup_A_s=PostingsFormat(name=Memory doPackFST= true), price=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Direct), n_l1=PostingsFormat(name=SimpleText), a_si=PostingsFormat(name=Direct), inStock=PostingsFormat(name=Memory doPackFST= true)}, sim=DefaultSimilarity, locale=en_IN, timezone=Atlantic/Canary
> [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=2,free=55622912,total=379584512
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [RecoveryZkTest, TestStressRecovery, TestSynonymFilterFactory, FastVectorHighlighterTest, DirectUpdateHandlerOptimizeTest, SolrCmdDistributorTest, SyncSliceTest, TestCodecSupport, BasicDistributedZkTest]
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.seed=D2EE76ADB2AC3F94 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_IN -Dtests.timezone=Atlantic/Canary -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4]   2>
> [junit4:junit4] ERROR   0.00s J0 | BasicDistributedZkTest (suite)
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=1280 closes=1281
> [junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
> [junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
> [junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
> [junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
> [junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> [junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
> [junit4:junit4]    >
> [junit4:junit4] Completed on J0 in 346.35s, 1 test, 1 failure <<< FAILURES!
> [...truncated 647 lines...]
>
> [...truncated 13455 lines...]
>
> [...truncated 13455 lines...]
>
> [...truncated 13455 lines...]
>
> [...truncated 13455 lines...]
>
> [...truncated 12612 lines...]
> [junit4:junit4]   2> 160727 T2662 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=36 closes=35
> [junit4:junit4]   2> NOTE: test params are: codec=SimpleText, sim=DefaultSimilarity, locale=th_TH_TH_#u-nu-thai, timezone=Pacific/Tongatapu
> [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=6,free=78040088,total=369098752
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [RecoveryZkTest, TestStressRecovery, TestSynonymFilterFactory, FastVectorHighlighterTest, DirectUpdateHandlerOptimizeTest, SolrCmdDistributorTest, SyncSliceTest]
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.seed=D2EE76ADB2AC3F94 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th_TH_TH_#u-nu-thai -Dtests.timezone=Pacific/Tongatapu -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4]   2>
> [junit4:junit4] ERROR   0.00s J0 | SyncSliceTest (suite)
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=36 closes=35
> [junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
> [junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
> [junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
> [junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
> [junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> [junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
> [junit4:junit4]    >
> [junit4:junit4] Completed on J0 in 160.80s, 1 test, 1 failure <<< FAILURES!
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.TestCodecSupport
> [junit4:junit4] Completed on J0 in 0.26s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.function.distance.DistanceFunctionTest
> [junit4:junit4] Completed on J1 in 1.28s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.TestMultiCoreConfBootstrap
> [junit4:junit4] Completed on J1 in 2.52s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.spelling.SpellingQueryConverterTest
> [junit4:junit4] Completed on J1 in 0.12s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.component.DebugComponentTest
> [junit4:junit4] Completed on J1 in 1.24s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.TestJmxMonitoredMap
> [junit4:junit4] Completed on J1 in 0.14s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.FieldAnalysisRequestHandlerTest
> [junit4:junit4] Completed on J1 in 1.13s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.OverseerTest
> [junit4:junit4] Completed on J1 in 34.01s, 8 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
> [junit4:junit4] Completed on J1 in 129.87s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.TestReplicationHandler
> [junit4:junit4] Completed on J1 in 32.55s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.component.DistributedSpellCheckComponentTest
> [junit4:junit4] Completed on J1 in 11.38s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestRealTimeGet
> [junit4:junit4] Completed on J1 in 10.46s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.ZkControllerTest
> [junit4:junit4] Completed on J1 in 7.14s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] HEARTBEAT J0: 2012-07-22T22:45:30, no events in: 62.2s, approx. at: BasicDistributedZkTest.testDistribSearch
> [junit4:junit4] Suite: org.apache.solr.TestDistributedGrouping
> [junit4:junit4] Completed on J1 in 16.96s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
> [junit4:junit4]    > (@AfterClass output)
> [junit4:junit4]   2> 225132 T2763 oas.SolrTestCaseJ4.deleteCore ###deleteCore
> [junit4:junit4]   2> 225735 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:486)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:483)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:431)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:412)
> [junit4:junit4]   2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:272)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 225735 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection2/leader_elect/shard1/election
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 225736 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection3/leader_elect/shard1/election
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 225737 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_11/leader_elect/shard1/election
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 225737 T2809 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_3/leader_elect/shard1/election
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 225737 T2809 oascc.ZkStateReader$3.process Updating live nodes
> [junit4:junit4]   2> 225737 T2809 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4]   2> 225738 T2809 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 227554 T2766 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
> [junit4:junit4]   2> 346333 T2763 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=1280 closes=1281
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=Direct), foo_b=PostingsFormat(name=Memory doPackFST= true), cat=PostingsFormat(name=SimpleText), foo_d=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), foo_f=PostingsFormat(name=Memory doPackFST= true), n_tl1=PostingsFormat(name=Direct), n_d1=PostingsFormat(name=SimpleText), rnd_b=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), intDefault=PostingsFormat(name=Direct), n_td1=PostingsFormat(name=Direct), id=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), timestamp=PostingsFormat(name=Direct), range_facet_sl=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), range_facet_si=PostingsFormat(name=SimpleText), oddField_s=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), sequence_i=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), name=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), foo_i=PostingsFormat(name=Direct), regex_dup_B_s=PostingsFormat(name=Direct), multiDefault=PostingsFormat(name=Direct), n_tf1=PostingsFormat(name=SimpleText), n_dt1=PostingsFormat(name=Direct), genre_s=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), author_t=PostingsFormat(name=Direct), n_ti1=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), range_facet_l=PostingsFormat(name=Direct), text=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=Direct), val_i=Pulsing40(freqCutoff=14 minBlockSize=36 maxBlockSize=119), SubjectTerms_mfacet=PostingsFormat(name=Direct), series_t=PostingsFormat(name=Direct), a_t=PostingsFormat(name=SimpleText), n_tdt1=PostingsFormat(name=Direct), regex_dup_A_s=PostingsFormat(name=Memory doPackFST= true), price=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Direct), n_l1=PostingsFormat(name=SimpleText), a_si=PostingsFormat(name=Direct), inStock=PostingsFormat(name=Memory doPackFST= true)}, sim=DefaultSimilarity, locale=en_IN, timezone=Atlantic/Canary
> [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=2,free=55622912,total=379584512
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [RecoveryZkTest, TestStressRecovery, TestSynonymFilterFactory, FastVectorHighlighterTest, DirectUpdateHandlerOptimizeTest, SolrCmdDistributorTest, SyncSliceTest, TestCodecSupport, BasicDistributedZkTest]
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.seed=D2EE76ADB2AC3F94 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_IN -Dtests.timezone=Atlantic/Canary -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4]   2>
> [junit4:junit4] ERROR   0.00s J0 | BasicDistributedZkTest (suite)
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=1280 closes=1281
> [junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([D2EE76ADB2AC3F94]:0)
> [junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
> [junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
> [junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
> [junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> [junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
> [junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
> [junit4:junit4]    >
> [junit4:junit4] Completed on J0 in 346.35s, 1 test, 1 failure <<< FAILURES!
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestPatternTokenizerFactory
> [junit4:junit4] Completed on J0 in 0.02s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.admin.LukeRequestHandlerTest
> [junit4:junit4] Completed on J0 in 2.40s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestSolrQueryParser
> [junit4:junit4] Completed on J0 in 0.71s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestSolrJ
> [junit4:junit4] Completed on J0 in 0.02s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestFrenchMinimalStemFilterFactory
> [junit4:junit4] Completed on J0 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestStandardFactories
> [junit4:junit4] Completed on J0 in 0.06s, 10 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.update.TestIndexingPerformance
> [junit4:junit4] Completed on J0 in 0.76s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestJapanesePartOfSpeechStopFilterFactory
> [junit4:junit4] Completed on J0 in 0.26s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestDictionaryCompoundWordTokenFilterFactory
> [junit4:junit4] Completed on J0 in 0.02s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.servlet.SolrRequestParserTest
> [junit4:junit4] Completed on J0 in 1.18s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.SolrCoreCheckLockOnStartupTest
> [junit4:junit4] Completed on J0 in 1.33s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.request.SimpleFacetsTest
> [junit4:junit4] Completed on J0 in 6.45s, 30 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestFinnishLightStemFilterFactory
> [junit4:junit4] Completed on J0 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestBulgarianStemFilterFactory
> [junit4:junit4] Completed on J0 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.TestBadConfig
> [junit4:junit4] Completed on J0 in 2.12s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.DoubleMetaphoneFilterFactoryTest
> [junit4:junit4] Completed on J0 in 0.10s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.TestPropInject
> [junit4:junit4] Completed on J0 in 1.31s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestReversedWildcardFilterFactory
> [junit4:junit4] Completed on J0 in 0.96s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestGermanStemFilterFactory
> [junit4:junit4] Completed on J0 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestGalicianStemFilterFactory
> [junit4:junit4] Completed on J0 in 0.03s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestIrishLowerCaseFilterFactory
> [junit4:junit4] Completed on J0 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.OutputWriterTest
> [junit4:junit4] Completed on J0 in 0.43s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.TestRandomFaceting
> [junit4:junit4] Completed on J1 in 85.61s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.update.SoftAutoCommitTest
> [junit4:junit4] Completed on J1 in 10.67s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.update.AutoCommitTest
> [junit4:junit4] Completed on J1 in 9.43s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.request.TestFaceting
> [junit4:junit4] Completed on J1 in 10.70s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.spelling.WordBreakSolrSpellCheckerTest
> [junit4:junit4] Completed on J1 in 1.25s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestStressVersions
> [junit4:junit4] Completed on J0 in 11.07s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestBrazilianStemFilterFactory
> [junit4:junit4] Completed on J0 in 0.02s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.component.StatsComponentTest
> [junit4:junit4] Completed on J0 in 6.06s, 7 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.TestHashPartitioner
> [junit4:junit4] Completed on J1 in 8.53s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestRecovery
> [junit4:junit4] Completed on J1 in 10.64s, 9 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.SolrCoreTest
> [junit4:junit4] Completed on J1 in 6.75s, 6 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.spelling.IndexBasedSpellCheckerTest
> [junit4:junit4] Completed on J1 in 1.30s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.update.DirectUpdateHandlerTest
> [junit4:junit4] Completed on J1 in 3.27s, 6 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.TestCoreContainer
> [junit4:junit4] Completed on J1 in 3.36s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestSort
> [junit4:junit4] Completed on J1 in 5.38s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.TestDistributedSearch
> [junit4:junit4] Completed on J0 in 95.36s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestLFUCache
> [junit4:junit4] Completed on J0 in 0.72s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.CommonGramsQueryFilterFactoryTest
> [junit4:junit4] Completed on J0 in 0.03s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.TestJmxIntegration
> [junit4:junit4] IGNORED 0.00s J0 | TestJmxIntegration.testJmxOnCoreReload
> [junit4:junit4]    > Cause: Annotated @Ignore(timing problem? https://issues.apache.org/jira/browse/SOLR-2715)
> [junit4:junit4] Completed on J0 in 1.47s, 3 tests, 1 skipped
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.SpatialFilterTest
> [junit4:junit4] Completed on J0 in 1.45s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.internal.csv.CSVStrategyTest
> [junit4:junit4] Completed on J0 in 0.02s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestPhoneticFilterFactory
> [junit4:junit4] Completed on J0 in 9.67s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestQueryUtils
> [junit4:junit4] Completed on J0 in 1.33s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.ZkNodePropsTest
> [junit4:junit4] Completed on J0 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.component.BadComponentTest
> [junit4:junit4] Completed on J0 in 0.60s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.util.FileUtilsTest
> [junit4:junit4] Completed on J0 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.TestGroupingSearch
> [junit4:junit4] Completed on J1 in 17.11s, 12 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.spelling.DirectSolrSpellCheckerTest
> [junit4:junit4] Completed on J1 in 1.39s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.update.PeerSyncTest
> [junit4:junit4] Completed on J1 in 4.26s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestExtendedDismaxParser
> [junit4:junit4] Completed on J0 in 8.96s, 10 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.SOLR749Test
> [junit4:junit4] Completed on J0 in 0.96s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestArabicFilters
> [junit4:junit4] Completed on J0 in 0.03s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.function.SortByFunctionTest
> [junit4:junit4] Completed on J1 in 1.92s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestIndexSearcher
> [junit4:junit4] Completed on J1 in 1.84s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.component.QueryElevationComponentTest
> [junit4:junit4] Completed on J0 in 4.83s, 7 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestSwedishLightStemFilterFactory
> [junit4:junit4] Completed on J0 in 0.02s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestNorwegianLightStemFilterFactory
> [junit4:junit4] Completed on J0 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestItalianLightStemFilterFactory
> [junit4:junit4] Completed on J0 in 0.02s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.function.TestFunctionQuery
> [junit4:junit4] Completed on J1 in 2.78s, 14 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.admin.CoreAdminHandlerTest
> [junit4:junit4] Completed on J0 in 1.50s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.TestTrie
> [junit4:junit4] Completed on J1 in 2.02s, 8 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.servlet.DirectSolrConnectionTest
> [junit4:junit4] Completed on J1 in 0.53s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.AnalysisAfterCoreReloadTest
> [junit4:junit4] Completed on J0 in 2.80s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestRemoveDuplicatesTokenFilterFactory
> [junit4:junit4] Completed on J0 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.util.DOMUtilTest
> [junit4:junit4] Completed on J0 in 0.06s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.MoreLikeThisHandlerTest
> [junit4:junit4] Completed on J0 in 0.93s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.servlet.CacheHeaderTest
> [junit4:junit4] Completed on J1 in 1.25s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.QueryEqualityTest
> [junit4:junit4] Completed on J1 in 1.20s, 58 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestWordDelimiterFilterFactory
> [junit4:junit4] Completed on J1 in 1.34s, 7 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.ConvertedLegacyTest
> [junit4:junit4] Completed on J0 in 2.99s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.LegacyHTMLStripCharFilterTest
> [junit4:junit4] IGNORED 0.00s J0 | LegacyHTMLStripCharFilterTest.testRandom
> [junit4:junit4]    > Cause: Annotated @Ignore(broken offsets: see LUCENE-2208)
> [junit4:junit4] Completed on J0 in 0.15s, 13 tests, 1 skipped
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.similarities.TestPerFieldSimilarity
> [junit4:junit4] Completed on J0 in 0.23s, 7 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.TestCSVLoader
> [junit4:junit4] Completed on J1 in 1.49s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.schema.PolyFieldTest
> [junit4:junit4] Completed on J1 in 1.63s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.response.TestCSVResponseWriter
> [junit4:junit4] Completed on J1 in 0.99s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.component.DistributedQueryElevationComponentTest
> [junit4:junit4] Completed on J1 in 2.11s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.schema.CurrencyFieldTest
> [junit4:junit4] IGNORED 0.00s J1 | CurrencyFieldTest.testPerformance
> [junit4:junit4]    > Cause: Annotated @Ignore()
> [junit4:junit4] Completed on J1 in 1.40s, 8 tests, 1 skipped
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.BinaryUpdateRequestHandlerTest
> [junit4:junit4] Completed on J1 in 0.92s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.QueryParsingTest
> [junit4:junit4] Completed on J1 in 0.89s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.component.TermsComponentTest
> [junit4:junit4] Completed on J1 in 1.06s, 13 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.SolrInfoMBeanTest
> [junit4:junit4] Completed on J1 in 1.02s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.MinimalSchemaTest
> [junit4:junit4] Completed on J1 in 0.72s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.StandardRequestHandlerTest
> [junit4:junit4] Completed on J1 in 1.16s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestQueryTypes
> [junit4:junit4] Completed on J1 in 1.03s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.response.TestPHPSerializedResponseWriter
> [junit4:junit4] Completed on J1 in 1.06s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.XmlUpdateRequestHandlerTest
> [junit4:junit4] Completed on J1 in 0.98s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.PingRequestHandlerTest
> [junit4:junit4] Completed on J1 in 1.17s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterWFSTTest
> [junit4:junit4] Completed on J1 in 1.30s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestValueSourceCache
> [junit4:junit4] Completed on J1 in 1.05s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.request.JSONWriterTest
> [junit4:junit4] Completed on J1 in 1.01s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.ReturnFieldsTest
> [junit4:junit4] Completed on J1 in 1.04s, 10 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.RequestHandlersTest
> [junit4:junit4] Completed on J1 in 0.81s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.schema.RequiredFieldsTest
> [junit4:junit4] Completed on J1 in 0.64s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterFSTTest
> [junit4:junit4] Completed on J1 in 1.66s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.cloud.LeaderElectionIntegrationTest
> [junit4:junit4] Completed on J0 in 29.26s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.schema.CopyFieldTest
> [junit4:junit4] Completed on J1 in 0.79s, 6 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterTSTTest
> [junit4:junit4] Completed on J1 in 1.63s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.update.processor.UniqFieldsUpdateProcessorFactoryTest
> [junit4:junit4] Completed on J1 in 0.76s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.update.UpdateParamsTest
> [junit4:junit4] Completed on J1 in 0.77s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterTest
> [junit4:junit4] Completed on J1 in 1.37s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.handler.admin.ShowFileRequestHandlerTest
> [junit4:junit4] Completed on J1 in 0.99s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestSearchPerf
> [junit4:junit4] Completed on J1 in 0.42s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.schema.BadIndexSchemaTest
> [junit4:junit4] Completed on J1 in 1.62s, 9 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.TestFoldingMultitermQuery
> [junit4:junit4] Completed on J1 in 1.20s, 18 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest
> [junit4:junit4] Completed on J1 in 1.30s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.servlet.NoCacheHeaderTest
> [junit4:junit4] Completed on J1 in 0.86s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.schema.PrimitiveFieldTypeTest
> [junit4:junit4] Completed on J1 in 1.09s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.AlternateDirectoryTest
> [junit4:junit4] Completed on J1 in 0.70s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.update.TestUpdate
> [junit4:junit4] Completed on J1 in 0.83s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.schema.TestBinaryField
> [junit4:junit4] Completed on J1 in 0.33s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.highlight.HighlighterConfigTest
> [junit4:junit4] Completed on J1 in 0.83s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.TestSolrDeletionPolicy2
> [junit4:junit4] Completed on J1 in 0.68s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.TestPropInjectDefaults
> [junit4:junit4] Completed on J1 in 0.68s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.update.processor.DefaultValueUpdateProcessorTest
> [junit4:junit4] Completed on J1 in 0.61s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.TestXIncludeConfig
> [junit4:junit4] Completed on J1 in 0.70s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.TestQuerySenderListener
> [junit4:junit4] Completed on J1 in 0.96s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.update.SolrIndexConfigTest
> [junit4:junit4] Completed on J1 in 0.89s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.schema.NumericFieldsTest
> [junit4:junit4] Completed on J1 in 0.47s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.util.TestNumberUtils
> [junit4:junit4] Completed on J1 in 0.16s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestJapaneseKatakanaStemFilterFactory
> [junit4:junit4] Completed on J1 in 0.02s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.TestSolrCoreProperties
> [junit4:junit4] Completed on J1 in 0.23s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.EchoParamsTest
> [junit4:junit4] Completed on J1 in 0.16s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestJapaneseTokenizerFactory
> [junit4:junit4] Completed on J1 in 0.04s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestKStemFilterFactory
> [junit4:junit4] Completed on J1 in 0.14s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.similarities.TestBM25SimilarityFactory
> [junit4:junit4] Completed on J1 in 0.14s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.spelling.suggest.TestPhraseSuggestions
> [junit4:junit4] Completed on J1 in 0.16s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.TestPluginEnable
> [junit4:junit4] Completed on J1 in 0.13s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestHyphenationCompoundWordTokenFilterFactory
> [junit4:junit4] Completed on J1 in 0.09s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.similarities.TestDFRSimilarityFactory
> [junit4:junit4] Completed on J1 in 0.16s, 3 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.similarities.TestIBSimilarityFactory
> [junit4:junit4] Completed on J1 in 0.16s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.search.similarities.TestDefaultSimilarityFactory
> [junit4:junit4] Completed on J1 in 0.19s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestHTMLStripCharFilterFactory
> [junit4:junit4] Completed on J1 in 0.03s, 6 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestThaiWordFilterFactory
> [junit4:junit4] Completed on J1 in 0.04s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.PluginInfoTest
> [junit4:junit4] Completed on J1 in 0.07s, 9 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestShingleFilterFactory
> [junit4:junit4] Completed on J1 in 0.05s, 13 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.util.PrimUtilsTest
> [junit4:junit4] Completed on J1 in 0.03s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestNGramFilters
> [junit4:junit4] Completed on J1 in 0.04s, 10 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestMultiWordSynonyms
> [junit4:junit4] Completed on J1 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.schema.OpenExchangeRatesOrgProviderTest
> [junit4:junit4] Completed on J1 in 0.06s, 5 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestCapitalizationFilterFactory
> [junit4:junit4] Completed on J1 in 0.04s, 7 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestCzechStemFilterFactory
> [junit4:junit4] Completed on J1 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.core.ResourceLoaderTest
> [junit4:junit4] Completed on J1 in 0.04s, 4 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.util.TestSystemIdResolver
> [junit4:junit4] Completed on J1 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestPortugueseMinimalStemFilterFactory
> [junit4:junit4] Completed on J1 in 0.03s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestDelimitedPayloadTokenFilterFactory
> [junit4:junit4] Completed on J1 in 0.02s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.schema.DateFieldTest
> [junit4:junit4] IGNORED 0.00s J1 | DateFieldTest.testRoundTripNonPositiveYear
> [junit4:junit4]    > Cause: Annotated @Ignore(SOLR-2773: Non-Positive years don't work)
> [junit4:junit4] Completed on J1 in 0.04s, 8 tests, 1 skipped
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestPortugueseStemFilterFactory
> [junit4:junit4] Completed on J1 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.spelling.TestSuggestSpellingConverter
> [junit4:junit4] Completed on J1 in 0.01s, 2 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestGermanLightStemFilterFactory
> [junit4:junit4] Completed on J1 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestPersianNormalizationFilterFactory
> [junit4:junit4] Completed on J1 in 0.01s, 1 test
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.internal.csv.CSVParserTest
> [junit4:junit4] Completed on J1 in 0.09s, 23 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.internal.csv.ExtendedBufferedReaderTest
> [junit4:junit4] Completed on J1 in 0.01s, 8 tests
> [junit4:junit4]  
> [junit4:junit4] Suite: org.apache.solr.analysis.TestElisionFilterFactory
> [...truncated 162 lines...]
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/build.xml:29: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build.xml:144: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/module-build.xml:62: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:1094: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:789: There were test failures: 297 suites, 1054 tests, 2 suite-level errors, 1 failure, 5 ignored
>
> Total time: 28 minutes 11 seconds
> Build step 'Execute shell' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]

- Mark Miller
lucidimagination.com












---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-tests-only-trunk-java7 - Build # 2949 - Still Failing

Apache Jenkins Server-2
In reply to this post by Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk-java7/2949/

1 tests failed.
FAILED:  org.apache.solr.cloud.FullSolrCloudTest.testDistribSearch

Error Message:
Timeout occured while waiting response from server at: http://localhost:49229/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://localhost:49229/solr/collection1
        at __randomizedtesting.SeedInfo.seed([17BBD8BCF412CA21:965D56A4834DAA1D]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:410)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
        at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
        at org.apache.solr.cloud.FullSolrCloudTest.index_specific(FullSolrCloudTest.java:504)
        at org.apache.solr.cloud.FullSolrCloudTest.brindDownShardIndexSomeDocsAndRecover(FullSolrCloudTest.java:722)
        at org.apache.solr.cloud.FullSolrCloudTest.doTest(FullSolrCloudTest.java:559)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:150)
        at java.net.SocketInputStream.read(SocketInputStream.java:121)
        at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:149)
        at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
        at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:264)
        at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:98)
        at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252)
        at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282)
        at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247)
        at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216)
        at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298)
        at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
        at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647)
        at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
        ... 45 more




Build Log:
[...truncated 12687 lines...]
[junit4:junit4]   2> 129227 T675 oaz.ZooKeeper.close Session: 0x138b155ed8b0005 closed
[junit4:junit4]   2> 129229 T675 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 129281 T675 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 49229
[junit4:junit4]   2> 129281 T675 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=68725729
[junit4:junit4]   2> 129281 T675 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:49229_solr_collection1
[junit4:junit4]   2> 129383 T746 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 129383 T675 oaz.ZooKeeper.close Session: 0x138b155ed8b0006 closed
[junit4:junit4]   2> 129385 T675 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 129435 T744 C97 P49229 REQ /update {wt=javabin&version=2} status=503 QTime=32836
[junit4:junit4]   2> 129436 T744 C97 P49229 oasc.SolrException.log SEVERE null:org.eclipse.jetty.io.EofException
[junit4:junit4]   2> at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:154)
[junit4:junit4]   2> at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:101)
[junit4:junit4]   2> at org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:185)
[junit4:junit4]   2> at org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:94)
[junit4:junit4]   2> at org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:49)
[junit4:junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:403)
[junit4:junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:288)
[junit4:junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
[junit4:junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
[junit4:junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:267)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1067)
[junit4:junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
[junit4:junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
[junit4:junit4]   2> at org.eclipse.jetty.server.Server.handle(Server.java:351)
[junit4:junit4]   2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
[junit4:junit4]   2> at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
[junit4:junit4]   2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
[junit4:junit4]   2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
[junit4:junit4]   2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:952)
[junit4:junit4]   2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4:junit4]   2> at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
[junit4:junit4]   2> at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
[junit4:junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
[junit4:junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 129438 T744 C97 P49229 oasc.SolrException.log SEVERE null:org.eclipse.jetty.io.EofException
[junit4:junit4]   2> at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:154)
[junit4:junit4]   2> at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:101)
[junit4:junit4]   2> at org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:185)
[junit4:junit4]   2> at org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:94)
[junit4:junit4]   2> at org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:49)
[junit4:junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:403)
[junit4:junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:288)
[junit4:junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
[junit4:junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
[junit4:junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:267)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1067)
[junit4:junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
[junit4:junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
[junit4:junit4]   2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
[junit4:junit4]   2> at org.eclipse.jetty.server.Server.handle(Server.java:351)
[junit4:junit4]   2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
[junit4:junit4]   2> at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
[junit4:junit4]   2> at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
[junit4:junit4]   2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
[junit4:junit4]   2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:952)
[junit4:junit4]   2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4:junit4]   2> at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
[junit4:junit4]   2> at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
[junit4:junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
[junit4:junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 129446 T744 C97 P49229 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4a01c5f2
[junit4:junit4]   2> 129453 T744 C97 P49229 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 129456 T744 C97 P49229 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=7,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 129457 T744 C97 P49229 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:49229_solr_collection1
[junit4:junit4]   2> 129527 T675 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/control_shard (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/control_shard/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/control_shard/election/88015175349370882-127.0.0.1:49220_solr_collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/control_shard (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:49220_solr",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:49220/solr"}
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "shard1":{
[junit4:junit4]   1>             "127.0.0.1:49222_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49222_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49222/solr"},
[junit4:junit4]   1>             "127.0.0.1:49226_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49226_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49226/solr"}},
[junit4:junit4]   1>           "shard2":{
[junit4:junit4]   1>             "127.0.0.1:49224_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard2",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49224_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49224/solr"},
[junit4:junit4]   1>             "127.0.0.1:49229_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard2",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49229_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49229/solr"}}},
[junit4:junit4]   1>         "control_collection":{"control_shard":{"127.0.0.1:49220_solr_collection1":{
[junit4:junit4]   1>               "shard":"control_shard",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"control_collection",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49220_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49220/solr"}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudTest -Dtests.method=testDistribSearch -Dtests.seed=17BBD8BCF412CA21 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_US -Dtests.timezone=SystemV/YST9YDT -Dtests.file.encoding=UTF-8
[junit4:junit4]   1>
[junit4:junit4]   2>
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 129568 T675 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=NestedPulsing), foo_b=PostingsFormat(name=SimpleText), foo_d=Lucene40(minBlockSize=3 maxBlockSize=70), foo_f=PostingsFormat(name=SimpleText), n_tl1=PostingsFormat(name=NestedPulsing), n_d1=Pulsing40(freqCutoff=13 minBlockSize=3 maxBlockSize=70), rnd_b=Lucene40(minBlockSize=3 maxBlockSize=70), intDefault=Pulsing40(freqCutoff=13 minBlockSize=3 maxBlockSize=70), n_td1=PostingsFormat(name=NestedPulsing), id=Lucene40(minBlockSize=3 maxBlockSize=70), timestamp=Pulsing40(freqCutoff=13 minBlockSize=3 maxBlockSize=70), range_facet_sl=PostingsFormat(name=SimpleText), range_facet_si=PostingsFormat(name=NestedPulsing), oddField_s=Lucene40(minBlockSize=3 maxBlockSize=70), multiDefault=PostingsFormat(name=NestedPulsing), n_tf1=Pulsing40(freqCutoff=13 minBlockSize=3 maxBlockSize=70), n_dt1=PostingsFormat(name=NestedPulsing), n_ti1=Lucene40(minBlockSize=3 maxBlockSize=70), range_facet_l=Pulsing40(freqCutoff=13 minBlockSize=3 maxBlockSize=70), text=PostingsFormat(name=SimpleText), _version_=Pulsing40(freqCutoff=13 minBlockSize=3 maxBlockSize=70), SubjectTerms_mfacet=Pulsing40(freqCutoff=13 minBlockSize=3 maxBlockSize=70), a_t=Pulsing40(freqCutoff=13 minBlockSize=3 maxBlockSize=70), n_tdt1=Pulsing40(freqCutoff=13 minBlockSize=3 maxBlockSize=70), other_tl1=Pulsing40(freqCutoff=13 minBlockSize=3 maxBlockSize=70), n_l1=Pulsing40(freqCutoff=13 minBlockSize=3 maxBlockSize=70), a_si=PostingsFormat(name=NestedPulsing)}, sim=RandomSimilarityProvider(queryNorm=false,coord=true): {}, locale=en_US, timezone=SystemV/YST9YDT
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=3,free=144361864,total=536870912
[junit4:junit4]   2> NOTE: All tests run in this JVM: [PeerSyncTest, NoCacheHeaderTest, TestPatternReplaceFilterFactory, TestDocumentBuilder, UniqFieldsUpdateProcessorFactoryTest, TestSolrXMLSerializer, TestLuceneMatchVersion, TestHunspellStemFilterFactory, TestNumberUtils, ZkSolrClientTest, TestSolrDeletionPolicy2, TestRecovery, TestUtils, TestStopFilterFactory, CSVRequestHandlerTest, TestHindiFilters, TestValueSourceCache, DirectSolrConnectionTest, TestStressLucene, TestIndonesianStemFilterFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, TestGroupingSearch, TestJapaneseReadingFormFilterFactory, TestShingleFilterFactory, TestGermanMinimalStemFilterFactory, TestTurkishLowerCaseFilterFactory, SolrPluginUtilsTest, TestJmxMonitoredMap, TestLMDirichletSimilarityFactory, SoftAutoCommitTest, LoggingHandlerTest, CircularListTest, TestGermanNormalizationFilterFactory, TestReplicationHandler, IndexReaderFactoryTest, TermVectorComponentTest, TestLMJelinekMercerSimilarityFactory, IndexSchemaRuntimeFieldTest, FieldAnalysisRequestHandlerTest, TestReload, TestConfig, PolyFieldTest, TestOmitPositions, TestCollationField, SpellingQueryConverterTest, TestQueryTypes, TestElisionFilterFactory, CommonGramsFilterFactoryTest, UpdateParamsTest, TestWikipediaTokenizerFactory, TestCzechStemFilterFactory, SpellPossibilityIteratorTest, TestSort, DistributedTermsComponentTest, UUIDFieldTest, SampleTest, TestBeiderMorseFilterFactory, TestDocSet, FullSolrCloudTest]
[junit4:junit4]   2>
[junit4:junit4] Completed on J1 in 129.59s, 1 test, 1 error <<< FAILURES!
[...truncated 500 lines...]

[...truncated 13338 lines...]

[...truncated 13338 lines...]

[...truncated 13338 lines...]

[...truncated 13338 lines...]

[...truncated 13325 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/build.xml:29: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build.xml:144: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/module-build.xml:62: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:1094: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:789: There were test failures: 297 suites, 1054 tests, 1 error, 5 ignored

Total time: 35 minutes 43 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-tests-only-trunk-java7 - Build # 2950 - Still Failing

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk-java7/2950/

1 tests failed.
FAILED:  org.apache.solr.cloud.FullSolrCloudTest.testDistribSearch

Error Message:
Shard still reported as live in zk

Stack Trace:
java.lang.AssertionError: Shard still reported as live in zk
        at __randomizedtesting.SeedInfo.seed([87EFC7C5D91A084C:60949DDAE456870]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.FullSolrCloudTest.brindDownShardIndexSomeDocsAndRecover(FullSolrCloudTest.java:715)
        at org.apache.solr.cloud.FullSolrCloudTest.doTest(FullSolrCloudTest.java:559)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)




Build Log:
[...truncated 12216 lines...]
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 96995 T56 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88015724125356034-127.0.0.1:27285_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 97341 T105 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:57073
[junit4:junit4]   2> 97688 T68 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:57073
[junit4:junit4]   2> 98026 T92 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:57073
[junit4:junit4]   2> 108141 T69 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 108141 T34 oaz.ZooKeeper.close Session: 0x138b1d5b3240003 closed
[junit4:junit4]   2> 108143 T34 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 108196 T34 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53538
[junit4:junit4]   2> 108196 T34 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 37233
[junit4:junit4]   2> 108196 T34 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=8849257
[junit4:junit4]   2> 108197 T34 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:37233_solr_collection1
[junit4:junit4]   2> 108197 T34 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6390c7a
[junit4:junit4]   2> 108203 T34 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 108203 T34 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=7,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 108206 T34 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:37233_solr_collection1
[junit4:junit4]   2> 108307 T93 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 108307 T34 oaz.ZooKeeper.close Session: 0x138b1d5b3240005 closed
[junit4:junit4]   2> 108309 T34 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 108361 T34 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 12825
[junit4:junit4]   2> 108361 T34 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1872108915
[junit4:junit4]   2> 108361 T34 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:12825_solr_collection1
[junit4:junit4]   2> 108463 T34 oaz.ZooKeeper.close Session: 0x138b1d5b3240006 closed
[junit4:junit4]   2> 108464 T34 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 108745 T34 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/control_shard/election/88015724125356034-127.0.0.1:27285_solr_collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/control_shard (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:27285_solr",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:27285/solr"}
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "shard1":{
[junit4:junit4]   1>             "127.0.0.1:10248_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:10248_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:10248/solr"},
[junit4:junit4]   1>             "127.0.0.1:37233_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:37233_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:37233/solr"}},
[junit4:junit4]   1>           "shard2":{
[junit4:junit4]   1>             "127.0.0.1:53538_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard2",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:53538_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:53538/solr"},
[junit4:junit4]   1>             "127.0.0.1:12825_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard2",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:12825_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:12825/solr"}}},
[junit4:junit4]   1>         "control_collection":{"control_shard":{"127.0.0.1:27285_solr_collection1":{
[junit4:junit4]   1>               "shard":"control_shard",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"control_collection",
[junit4:junit4]   1>               "node_name":"127.0.0.1:27285_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:27285/solr"}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudTest -Dtests.method=testDistribSearch -Dtests.seed=87EFC7C5D91A084C -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh -Dtests.timezone=America/Goose_Bay -Dtests.file.encoding=US-ASCII
[junit4:junit4]   1>
[junit4:junit4]   2>
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 108792 T34 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 109463 T106 oasc.SyncStrategy.syncToMe Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:53538/solr/collection1
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncToMe(SyncStrategy.java:237)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:119)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:82)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:158)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to 127.0.0.1:53538 timed out
[junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:125)
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4]   2> ... 11 more
[junit4:junit4]   2>
[junit4:junit4]   2> 109464 T106 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:12825_solr_collection1
[junit4:junit4]   2> 109465 T106 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6ce96831
[junit4:junit4]   2> 109471 T106 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 109478 T106 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 109479 T106 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:12825_solr_collection1
[junit4:junit4]   2> 109480 T106 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:244)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:236)
[junit4:junit4]   2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:734)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:168)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 109481 T106 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 109481 T106 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 109481 T106 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42c3d37a name:ZooKeeperConnection Watcher:127.0.0.1:57073/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 109481 T106 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=MockRandom), foo_b=MockVariableIntBlock(baseBlockSize=50), foo_d=PostingsFormat(name=NestedPulsing), foo_f=MockVariableIntBlock(baseBlockSize=50), n_tl1=PostingsFormat(name=MockRandom), n_d1=PostingsFormat(name=Memory doPackFST= true), rnd_b=PostingsFormat(name=NestedPulsing), intDefault=PostingsFormat(name=Memory doPackFST= true), n_td1=PostingsFormat(name=MockRandom), id=PostingsFormat(name=NestedPulsing), timestamp=PostingsFormat(name=Memory doPackFST= true), range_facet_sl=MockVariableIntBlock(baseBlockSize=50), range_facet_si=PostingsFormat(name=MockRandom), oddField_s=MockVariableIntBlock(baseBlockSize=50), multiDefault=PostingsFormat(name=MockRandom), n_tf1=PostingsFormat(name=Memory doPackFST= true), n_dt1=PostingsFormat(name=MockRandom), n_ti1=PostingsFormat(name=NestedPulsing), range_facet_l=PostingsFormat(name=Memory doPackFST= true), text=MockVariableIntBlock(baseBlockSize=50), _version_=PostingsFormat(name=Memory doPackFST= true), SubjectTerms_mfacet=PostingsFormat(name=Memory doPackFST= true), a_t=PostingsFormat(name=Memory doPackFST= true), n_tdt1=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Memory doPackFST= true), n_l1=PostingsFormat(name=Memory doPackFST= true), a_si=PostingsFormat(name=MockRandom)}, sim=DefaultSimilarity, locale=zh, timezone=America/Goose_Bay
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=1,free=54955664,total=153092096
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestRangeQuery, CloudStateTest, TestIndexSearcher, FullSolrCloudTest]
[junit4:junit4]   2>
[junit4:junit4] Completed on J1 in 109.83s, 1 test, 1 failure <<< FAILURES!
[...truncated 782 lines...]

[...truncated 13149 lines...]

[...truncated 13149 lines...]

[...truncated 13149 lines...]

[...truncated 13149 lines...]

[...truncated 13136 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/build.xml:29: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build.xml:144: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/module-build.xml:62: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:1094: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:789: There were test failures: 297 suites, 1054 tests, 1 failure, 5 ignored

Total time: 35 minutes 55 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-tests-only-trunk-java7 - Build # 2951 - Still Failing

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk-java7/2951/

1 tests failed.
FAILED:  org.apache.solr.cloud.FullSolrCloudTest.testDistribSearch

Error Message:
Shard still reported as live in zk

Stack Trace:
java.lang.AssertionError: Shard still reported as live in zk
        at __randomizedtesting.SeedInfo.seed([C1F1112EF8AF901C:40179F368FF0F020]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.FullSolrCloudTest.brindDownShardIndexSomeDocsAndRecover(FullSolrCloudTest.java:715)
        at org.apache.solr.cloud.FullSolrCloudTest.doTest(FullSolrCloudTest.java:559)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)




Build Log:
[...truncated 12397 lines...]
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 84365 T1040 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88017247552733186-127.0.0.1:33008_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 85741 T1022 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 85752 T1076 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:33005
[junit4:junit4]   2> 85851 T1089 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:33005
[junit4:junit4]   2> 85855 T1052 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:33005
[junit4:junit4]   2> 96242 T1053 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 96242 T1019 oaz.ZooKeeper.close Session: 0x138b338667d0003 closed
[junit4:junit4]   2> 96244 T1019 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 96297 T1019 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 33012
[junit4:junit4]   2> 96297 T1019 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 33014
[junit4:junit4]   2> 96297 T1019 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1467081208
[junit4:junit4]   2> 96298 T1019 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:33014_solr_collection1
[junit4:junit4]   2> 96298 T1019 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1f970b01
[junit4:junit4]   2> 96300 T1019 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 96301 T1019 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=7,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 96303 T1019 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:33014_solr_collection1
[junit4:junit4]   2> 96404 T1077 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 96404 T1019 oaz.ZooKeeper.close Session: 0x138b338667d0005 closed
[junit4:junit4]   2> 96405 T1019 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 96458 T1019 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 33016
[junit4:junit4]   2> 96458 T1019 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1544269386
[junit4:junit4]   2> 96458 T1019 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:33016_solr_collection1
[junit4:junit4]   2> 96560 T1019 oaz.ZooKeeper.close Session: 0x138b338667d0006 closed
[junit4:junit4]   2> 96561 T1019 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 96672 T1019 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/control_shard/election/88017247552733186-127.0.0.1:33008_solr_collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/control_shard (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:33008_solr",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:33008/solr"}
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "shard1":{
[junit4:junit4]   1>             "127.0.0.1:33010_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:33010_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:33010/solr"},
[junit4:junit4]   1>             "127.0.0.1:33014_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:33014_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:33014/solr"}},
[junit4:junit4]   1>           "shard2":{
[junit4:junit4]   1>             "127.0.0.1:33012_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard2",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:33012_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:33012/solr"},
[junit4:junit4]   1>             "127.0.0.1:33016_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard2",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:33016_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:33016/solr"}}},
[junit4:junit4]   1>         "control_collection":{"control_shard":{"127.0.0.1:33008_solr_collection1":{
[junit4:junit4]   1>               "shard":"control_shard",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"control_collection",
[junit4:junit4]   1>               "node_name":"127.0.0.1:33008_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:33008/solr"}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudTest -Dtests.method=testDistribSearch -Dtests.seed=C1F1112EF8AF901C -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_PA -Dtests.timezone=Kwajalein -Dtests.file.encoding=US-ASCII
[junit4:junit4]   1>
[junit4:junit4]   2>
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 96714 T1019 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 97743 T1090 oasc.SyncStrategy.syncToMe Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33012/solr/collection1
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncToMe(SyncStrategy.java:237)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:119)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:82)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:158)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to 127.0.0.1:33012 timed out
[junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:125)
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4]   2> ... 11 more
[junit4:junit4]   2>
[junit4:junit4]   2> 97744 T1090 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:33016_solr_collection1
[junit4:junit4]   2> 97744 T1090 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@38f7450f
[junit4:junit4]   2> 97749 T1090 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 97751 T1090 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 97752 T1090 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:33016_solr_collection1
[junit4:junit4]   2> 97752 T1090 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:244)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:236)
[junit4:junit4]   2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:734)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:168)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 97753 T1090 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 97753 T1090 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 97753 T1090 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e9f8c61 name:ZooKeeperConnection Watcher:127.0.0.1:33005/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 97753 T1090 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=SimpleText), foo_b=PostingsFormat(name=Memory doPackFST= false), foo_d=PostingsFormat(name=Direct), foo_f=PostingsFormat(name=Memory doPackFST= false), n_tl1=PostingsFormat(name=SimpleText), n_d1=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), rnd_b=PostingsFormat(name=Direct), intDefault=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), n_td1=PostingsFormat(name=SimpleText), id=PostingsFormat(name=Direct), timestamp=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), range_facet_sl=PostingsFormat(name=Memory doPackFST= false), range_facet_si=PostingsFormat(name=SimpleText), oddField_s=PostingsFormat(name=Memory doPackFST= false), multiDefault=PostingsFormat(name=SimpleText), n_tf1=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), n_dt1=PostingsFormat(name=SimpleText), n_ti1=PostingsFormat(name=Direct), range_facet_l=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), text=PostingsFormat(name=Memory doPackFST= false), _version_=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), SubjectTerms_mfacet=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), a_t=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), n_tdt1=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), other_tl1=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), n_l1=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), a_si=PostingsFormat(name=SimpleText)}, sim=RandomSimilarityProvider(queryNorm=false,coord=true): {}, locale=es_PA, timezone=Kwajalein
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=1,free=205159696,total=384827392
[junit4:junit4]   2> NOTE: All tests run in this JVM: [NotRequiredUniqueKeyTest, TestCollationField, DocumentBuilderTest, TestGermanNormalizationFilterFactory, TestIndexSearcher, TestJapaneseTokenizerFactory, ScriptEngineTest, DocumentAnalysisRequestHandlerTest, TestQueryTypes, TestPortugueseLightStemFilterFactory, BadIndexSchemaTest, NoCacheHeaderTest, TestLMDirichletSimilarityFactory, URLClassifyProcessorTest, MultiTermTest, CommonGramsFilterFactoryTest, TestNGramFilters, IndexSchemaTest, MBeansHandlerTest, TestSort, TestSolrXMLSerializer, XsltUpdateRequestHandlerTest, SearchHandlerTest, TestFastLRUCache, JsonLoaderTest, LeaderElectionTest, TestDefaultSimilarityFactory, TestRecovery, DistanceFunctionTest, TestWikipediaTokenizerFactory, TestReload, TestLRUCache, TestElisionFilterFactory, TestIBSimilarityFactory, TestDocumentBuilder, SpellCheckComponentTest, TermVectorComponentTest, TestLMJelinekMercerSimilarityFactory, SolrCoreTest, PrimUtilsTest, TestHungarianLightStemFilterFactory, TestGroupingSearch, TestGermanMinimalStemFilterFactory, DebugComponentTest, TestQuerySenderNoQuery, LoggingHandlerTest, StandardRequestHandlerTest, TestTrie, UniqFieldsUpdateProcessorFactoryTest, TestJapaneseIterationMarkCharFilterFactory, TestPatternReplaceFilterFactory, TestCoreContainer, TestKeywordMarkerFilterFactory, AlternateDirectoryTest, SpellPossibilityIteratorTest, TestHindiFilters, BasicZkTest, RAMDirectoryFactoryTest, TestSystemIdResolver, TestMultiCoreConfBootstrap, TestWriterPerf, TestStressLucene, TestDocSet, TestShingleFilterFactory, CloudStateTest, CloudStateUpdateTest, TestPseudoReturnFields, ZkSolrClientTest, QueryParsingTest, SoftAutoCommitTest, OverseerTest, FullSolrCloudTest]
[junit4:junit4]   2>
[junit4:junit4] Completed on J1 in 98.73s, 1 test, 1 failure <<< FAILURES!
[...truncated 565 lines...]

[...truncated 13113 lines...]

[...truncated 13113 lines...]

[...truncated 13113 lines...]

[...truncated 13113 lines...]

[...truncated 13100 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/build.xml:29: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build.xml:144: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/module-build.xml:62: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:1094: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:789: There were test failures: 297 suites, 1054 tests, 1 failure, 5 ignored

Total time: 29 minutes 55 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: [JENKINS] Lucene-Solr-tests-only-trunk-java7 - Build # 2951 - Still Failing

Mark Miller-3
I'll make some attempts today to try and get this happy on the apache Jenkins sever.

Sent from my iPhone

On Jul 23, 2012, at 5:55 AM, Apache Jenkins Server <[hidden email]> wrote:

> Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk-java7/2951/
>
> 1 tests failed.
> FAILED:  org.apache.solr.cloud.FullSolrCloudTest.testDistribSearch
>
> Error Message:
> Shard still reported as live in zk
>
> Stack Trace:
> java.lang.AssertionError: Shard still reported as live in zk
>    at __randomizedtesting.SeedInfo.seed([C1F1112EF8AF901C:40179F368FF0F020]:0)
>    at org.junit.Assert.fail(Assert.java:93)
>    at org.apache.solr.cloud.FullSolrCloudTest.brindDownShardIndexSomeDocsAndRecover(FullSolrCloudTest.java:715)
>    at org.apache.solr.cloud.FullSolrCloudTest.doTest(FullSolrCloudTest.java:559)
>    at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
>    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:601)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
>    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>    at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>    at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
>    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>    at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
>    at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
>    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>    at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>    at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
>    at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
>    at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
>    at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>    at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
>    at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
>    at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
>    at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>    at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>    at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
>    at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
>
>
>
>
> Build Log:
> [...truncated 12397 lines...]
> [junit4:junit4]   2>    at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 84365 T1040 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88017247552733186-127.0.0.1:33008_solr-n_0000000000) am no longer a leader.
> [junit4:junit4]   2> 85741 T1022 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
> [junit4:junit4]   2> 85752 T1076 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:33005
> [junit4:junit4]   2> 85851 T1089 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:33005
> [junit4:junit4]   2> 85855 T1052 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:33005
> [junit4:junit4]   2> 96242 T1053 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 96242 T1019 oaz.ZooKeeper.close Session: 0x138b338667d0003 closed
> [junit4:junit4]   2> 96244 T1019 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
> [junit4:junit4]   2> 96297 T1019 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 33012
> [junit4:junit4]   2> 96297 T1019 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 33014
> [junit4:junit4]   2> 96297 T1019 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1467081208
> [junit4:junit4]   2> 96298 T1019 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:33014_solr_collection1
> [junit4:junit4]   2> 96298 T1019 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1f970b01
> [junit4:junit4]   2> 96300 T1019 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
> [junit4:junit4]   2> 96301 T1019 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=7,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   2> 96303 T1019 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:33014_solr_collection1
> [junit4:junit4]   2> 96404 T1077 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> 96404 T1019 oaz.ZooKeeper.close Session: 0x138b338667d0005 closed
> [junit4:junit4]   2> 96405 T1019 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
> [junit4:junit4]   2> 96458 T1019 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 33016
> [junit4:junit4]   2> 96458 T1019 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1544269386
> [junit4:junit4]   2> 96458 T1019 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:33016_solr_collection1
> [junit4:junit4]   2> 96560 T1019 oaz.ZooKeeper.close Session: 0x138b338667d0006 closed
> [junit4:junit4]   2> 96561 T1019 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
> [junit4:junit4]   2> 96672 T1019 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
> [junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/control_shard/election/88017247552733186-127.0.0.1:33008_solr_collection1-n_0000000000 (0)
> [junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
> [junit4:junit4]   1>      /solr/collections/control_collection/leaders/control_shard (0)
> [junit4:junit4]   1>      DATA:
> [junit4:junit4]   1>          {
> [junit4:junit4]   1>            "core":"collection1",
> [junit4:junit4]   1>            "node_name":"127.0.0.1:33008_solr",
> [junit4:junit4]   1>            "base_url":"http://127.0.0.1:33008/solr"}
> [junit4:junit4]   1>   /solr/clusterstate.json (0)
> [junit4:junit4]   1>   DATA:
> [junit4:junit4]   1>       {
> [junit4:junit4]   1>         "collection1":{
> [junit4:junit4]   1>           "shard1":{
> [junit4:junit4]   1>             "127.0.0.1:33010_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard1",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "leader":"true",
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:33010_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:33010/solr"},
> [junit4:junit4]   1>             "127.0.0.1:33014_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard1",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:33014_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:33014/solr"}},
> [junit4:junit4]   1>           "shard2":{
> [junit4:junit4]   1>             "127.0.0.1:33012_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard2",
> [junit4:junit4]   1>               "leader":"true",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:33012_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:33012/solr"},
> [junit4:junit4]   1>             "127.0.0.1:33016_solr_collection1":{
> [junit4:junit4]   1>               "shard":"shard2",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"collection1",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:33016_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:33016/solr"}}},
> [junit4:junit4]   1>         "control_collection":{"control_shard":{"127.0.0.1:33008_solr_collection1":{
> [junit4:junit4]   1>               "shard":"control_shard",
> [junit4:junit4]   1>               "roles":null,
> [junit4:junit4]   1>               "leader":"true",
> [junit4:junit4]   1>               "state":"active",
> [junit4:junit4]   1>               "core":"collection1",
> [junit4:junit4]   1>               "collection":"control_collection",
> [junit4:junit4]   1>               "node_name":"127.0.0.1:33008_solr",
> [junit4:junit4]   1>               "base_url":"http://127.0.0.1:33008/solr"}}}}
> [junit4:junit4]   1>  /zookeeper (1)
> [junit4:junit4]   1>  DATA:
> [junit4:junit4]   1>      
> [junit4:junit4]   1>
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudTest -Dtests.method=testDistribSearch -Dtests.seed=C1F1112EF8AF901C -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_PA -Dtests.timezone=Kwajalein -Dtests.file.encoding=US-ASCII
> [junit4:junit4]   1>
> [junit4:junit4]   2>
> [junit4:junit4]    > (@AfterClass output)
> [junit4:junit4]   2> 96714 T1019 oas.SolrTestCaseJ4.deleteCore ###deleteCore
> [junit4:junit4]   2> 97743 T1090 oasc.SyncStrategy.syncToMe Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:33012/solr/collection1
> [junit4:junit4]   2>    at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414)
> [junit4:junit4]   2>    at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
> [junit4:junit4]   2>    at org.apache.solr.cloud.SyncStrategy.syncToMe(SyncStrategy.java:237)
> [junit4:junit4]   2>    at org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:119)
> [junit4:junit4]   2>    at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:82)
> [junit4:junit4]   2>    at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:158)
> [junit4:junit4]   2>    at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
> [junit4:junit4]   2>    at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
> [junit4:junit4]   2>    at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2>    at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2>    at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2>    at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2> Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to 127.0.0.1:33012 timed out
> [junit4:junit4]   2>    at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:125)
> [junit4:junit4]   2>    at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
> [junit4:junit4]   2>    at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
> [junit4:junit4]   2>    at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
> [junit4:junit4]   2>    at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
> [junit4:junit4]   2>    at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
> [junit4:junit4]   2>    at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
> [junit4:junit4]   2>    at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
> [junit4:junit4]   2>    at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
> [junit4:junit4]   2>    at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
> [junit4:junit4]   2>    ... 11 more
> [junit4:junit4]   2>
> [junit4:junit4]   2> 97744 T1090 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:33016_solr_collection1
> [junit4:junit4]   2> 97744 T1090 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@38f7450f
> [junit4:junit4]   2> 97749 T1090 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
> [junit4:junit4]   2> 97751 T1090 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   2> 97752 T1090 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:33016_solr_collection1
> [junit4:junit4]   2> 97752 T1090 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
> [junit4:junit4]   2>    at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
> [junit4:junit4]   2>    at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> [junit4:junit4]   2>    at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
> [junit4:junit4]   2>    at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:244)
> [junit4:junit4]   2>    at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:241)
> [junit4:junit4]   2>    at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
> [junit4:junit4]   2>    at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:241)
> [junit4:junit4]   2>    at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:236)
> [junit4:junit4]   2>    at org.apache.solr.cloud.ZkController.publish(ZkController.java:734)
> [junit4:junit4]   2>    at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:168)
> [junit4:junit4]   2>    at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
> [junit4:junit4]   2>    at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
> [junit4:junit4]   2>    at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
> [junit4:junit4]   2>    at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
> [junit4:junit4]   2>    at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
> [junit4:junit4]   2>    at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 97753 T1090 oascc.ZkStateReader$3.process Updating live nodes
> [junit4:junit4]   2> 97753 T1090 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4]   2> 97753 T1090 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e9f8c61 name:ZooKeeperConnection Watcher:127.0.0.1:33005/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
> [junit4:junit4]   2> 97753 T1090 oaz.ClientCnxn$EventThread.run EventThread shut down
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=SimpleText), foo_b=PostingsFormat(name=Memory doPackFST= false), foo_d=PostingsFormat(name=Direct), foo_f=PostingsFormat(name=Memory doPackFST= false), n_tl1=PostingsFormat(name=SimpleText), n_d1=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), rnd_b=PostingsFormat(name=Direct), intDefault=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), n_td1=PostingsFormat(name=SimpleText), id=PostingsFormat(name=Direct), timestamp=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), range_facet_sl=PostingsFormat(name=Memory doPackFST= false), range_facet_si=PostingsFormat(name=SimpleText), oddField_s=PostingsFormat(name=Memory doPackFST= false), multiDefault=PostingsFormat(name=SimpleText), n_tf1=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), n_dt1=PostingsFormat(name=SimpleText), n_ti1=PostingsFormat(name=Direct), range_facet_l=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), text=PostingsFormat(name=Memory doPackFST= false), _version_=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), SubjectTerms_mfacet=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), a_t=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), n_tdt1=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), other_tl1=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), n_l1=Pulsing40(freqCutoff=13 minBlockSize=28 maxBlockSize=134), a_si=PostingsFormat(name=SimpleText)}, sim=RandomSimilarityProvider(queryNorm=false,coord=true): {}, locale=es_PA, timezone=Kwajalein
> [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=1,free=205159696,total=384827392
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [NotRequiredUniqueKeyTest, TestCollationField, DocumentBuilderTest, TestGermanNormalizationFilterFactory, TestIndexSearcher, TestJapaneseTokenizerFactory, ScriptEngineTest, DocumentAnalysisRequestHandlerTest, TestQueryTypes, TestPortugueseLightStemFilterFactory, BadIndexSchemaTest, NoCacheHeaderTest, TestLMDirichletSimilarityFactory, URLClassifyProcessorTest, MultiTermTest, CommonGramsFilterFactoryTest, TestNGramFilters, IndexSchemaTest, MBeansHandlerTest, TestSort, TestSolrXMLSerializer, XsltUpdateRequestHandlerTest, SearchHandlerTest, TestFastLRUCache, JsonLoaderTest, LeaderElectionTest, TestDefaultSimilarityFactory, TestRecovery, DistanceFunctionTest, TestWikipediaTokenizerFactory, TestReload, TestLRUCache, TestElisionFilterFactory, TestIBSimilarityFactory, TestDocumentBuilder, SpellCheckComponentTest, TermVectorComponentTest, TestLMJelinekMercerSimilarityFactory, SolrCoreTest, PrimUtilsTest, TestHungarianLightStemFilterFactory, TestGroupingSearch, TestGermanMinimalStemFilterFactory, DebugComponentTest, TestQuerySenderNoQuery, LoggingHandlerTest, StandardRequestHandlerTest, TestTrie, UniqFieldsUpdateProcessorFactoryTest, TestJapaneseIterationMarkCharFilterFactory, TestPatternReplaceFilterFactory, TestCoreContainer, TestKeywordMarkerFilterFactory, AlternateDirectoryTest, SpellPossibilityIteratorTest, TestHindiFilters, BasicZkTest, RAMDirectoryFactoryTest, TestSystemIdResolver, TestMultiCoreConfBootstrap, TestWriterPerf, TestStressLucene, TestDocSet, TestShingleFilterFactory, CloudStateTest, CloudStateUpdateTest, TestPseudoReturnFields, ZkSolrClientTest, QueryParsingTest, SoftAutoCommitTest, OverseerTest, FullSolrCloudTest]
> [junit4:junit4]   2>
> [junit4:junit4] Completed on J1 in 98.73s, 1 test, 1 failure <<< FAILURES!
> [...truncated 565 lines...]
>
> [...truncated 13113 lines...]
>
> [...truncated 13113 lines...]
>
> [...truncated 13113 lines...]
>
> [...truncated 13113 lines...]
>
> [...truncated 13100 lines...]
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/build.xml:29: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build.xml:144: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/module-build.xml:62: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:1094: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:789: There were test failures: 297 suites, 1054 tests, 1 failure, 5 ignored
>
> Total time: 29 minutes 55 seconds
> Build step 'Execute shell' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-tests-only-trunk-java7 - Build # 2952 - Still Failing

Apache Jenkins Server-2
In reply to this post by Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk-java7/2952/

3 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
Could not find new 4 slice collection called awholynewcollection_4

Stack Trace:
java.lang.AssertionError: Could not find new 4 slice collection called awholynewcollection_4
        at __randomizedtesting.SeedInfo.seed([AF27CBE78E432BDD:2EC145FFF91C4BE1]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.BasicDistributedZkTest.checkForCollection(BasicDistributedZkTest.java:570)
        at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:351)
        at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:309)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest

Error Message:
ERROR: SolrIndexSearcher opens=0 closes=1

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=0 closes=1
        at __randomizedtesting.SeedInfo.seed([AF27CBE78E432BDD]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
        at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SyncSliceTest

Error Message:
ERROR: SolrIndexSearcher opens=24 closes=23

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=24 closes=23
        at __randomizedtesting.SeedInfo.seed([AF27CBE78E432BDD]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
        at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)




Build Log:
[...truncated 10160 lines...]
[junit4:junit4]   2>
[junit4:junit4]   2> 70778 T492 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 70779 T492 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 70779 T492 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 70780 T492 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 96462 T479 oasc.SyncStrategy.syncToMe Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:49920/solr/collection1
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncToMe(SyncStrategy.java:237)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:119)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:82)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:158)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to 127.0.0.1:49920 timed out
[junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:125)
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4]   2> ... 11 more
[junit4:junit4]   2>
[junit4:junit4]   2> 96463 T479 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:49935_solr_collection1
[junit4:junit4]   2> 96464 T479 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:244)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:236)
[junit4:junit4]   2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:734)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:168)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 96464 T479 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 96465 T479 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 96465 T479 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 96465 T479 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 96657 T471 C41 P49935 oasc.SolrException.log SEVERE shard update error StdNode: http://127.0.0.1:49920/solr/collection1/:org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:49920/solr/collection1
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:407)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
[junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:336)
[junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:317)
[junit4:junit4]   2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4:junit4]   2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$BoundedExecutor$1.run(SolrCmdDistributor.java:538)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connection to http://127.0.0.1:49920 refused
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:158)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4]   2> ... 12 more
[junit4:junit4]   2> Caused by: java.net.ConnectException: Operation timed out
[junit4:junit4]   2> at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
[junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
[junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
[junit4:junit4]   2> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
[junit4:junit4]   2> at java.net.Socket.connect(Socket.java:579)
[junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123)
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
[junit4:junit4]   2> ... 20 more
[junit4:junit4]   2>
[junit4:junit4]   2> 162200 T433 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=24 closes=23
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {range_facet_l=MockVariableIntBlock(baseBlockSize=60), text=Pulsing40(freqCutoff=10 minBlockSize=32 maxBlockSize=82), _version_=MockVariableIntBlock(baseBlockSize=60), rnd_b=PostingsFormat(name=Memory doPackFST= false), intDefault=MockVariableIntBlock(baseBlockSize=60), id=PostingsFormat(name=Memory doPackFST= false), timestamp=MockVariableIntBlock(baseBlockSize=60), a_t=PostingsFormat(name=SimpleText), range_facet_sl=PostingsFormat(name=Memory doPackFST= false), range_facet_si=PostingsFormat(name=SimpleText), other_tl1=MockVariableIntBlock(baseBlockSize=60), multiDefault=MockVariableIntBlock(baseBlockSize=60), a_si=MockVariableIntBlock(baseBlockSize=60)}, sim=RandomSimilarityProvider(queryNorm=true,coord=true): {}, locale=sk, timezone=America/Rosario
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=6,free=190428872,total=318767104
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestSolrCoreProperties, TestBinaryField, TestSolrQueryParser, UpdateRequestProcessorFactoryTest, SolrRequestParserTest, DOMUtilTest, OutputWriterTest, HighlighterTest, CacheHeaderTest, TestFrenchLightStemFilterFactory, TestWordDelimiterFilterFactory, TestPHPSerializedResponseWriter, SolrInfoMBeanTest, TestGermanStemFilterFactory, TestUpdate, TestCSVLoader, TestPortugueseMinimalStemFilterFactory, LeaderElectionIntegrationTest, TestTypeTokenFilterFactory, TestStandardFactories, DateMathParserTest, MinimalSchemaTest, TestPropInject, TestJoin, DoubleMetaphoneFilterFactoryTest, TestIndexingPerformance, StatelessScriptUpdateProcessorFactoryTest, PluginInfoTest, BasicFunctionalityTest, CommonGramsQueryFilterFactoryTest, AutoCommitTest, SuggesterTest, TestDistributedSearch, SOLR749Test, TestBM25SimilarityFactory, TestSynonymFilterFactory, TestMappingCharFilterFactory, TestThaiWordFilterFactory, TermsComponentTest, TestFinnishLightStemFilterFactory, TestFiltering, TestPatternReplaceCharFilterFactory, QueryElevationComponentTest, TestFrenchMinimalStemFilterFactory, TestTrimFilterFactory, TestRemoveDuplicatesTokenFilterFactory, EchoParamsTest, TestGreekLowerCaseFilterFactory, ZkNodePropsTest, ShowFileRequestHandlerTest, TestHTMLStripCharFilterFactory, TestStressRecovery, TestMergePolicyConfig, DirectUpdateHandlerOptimizeTest, XmlUpdateRequestHandlerTest, SolrCoreCheckLockOnStartupTest, TestPatternTokenizerFactory, SystemInfoHandlerTest, TestPortugueseStemFilterFactory, TestDelimitedPayloadTokenFilterFactory, SolrIndexConfigTest, TestBulgarianStemFilterFactory, MoreLikeThisHandlerTest, TestDFRSimilarityFactory, RequiredFieldsTest, TestCJKWidthFilterFactory, SyncSliceTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.seed=AF27CBE78E432BDD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sk -Dtests.timezone=America/Rosario -Dtests.file.encoding=UTF-8
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | SyncSliceTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=24 closes=23
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([AF27CBE78E432BDD]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 162.25s, 1 test, 1 failure <<< FAILURES!
[...truncated 16483 lines...]
[junit4:junit4]   2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
[junit4:junit4]   2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4:junit4]   2> at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
[junit4:junit4]   2> at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
[junit4:junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
[junit4:junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 199457 T1502 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1819091070
[junit4:junit4]   2> 199458 T1502 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection2 zkNodeName=127.0.0.1:49909_solr_collection2
[junit4:junit4]   2> 199458 T1502 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection3 zkNodeName=127.0.0.1:49909_solr_collection3
[junit4:junit4]   2> 199458 T1502 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@79cf74c7
[junit4:junit4]   2> 199460 T1502 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 199461 T1502 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=431,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=157,cumulative_deletesById=0,cumulative_deletesByQuery=3,cumulative_errors=0}
[junit4:junit4]   2> 199464 T1502 oasc.SolrCore.close [collection2]  CLOSING SolrCore org.apache.solr.core.SolrCore@1442edcc
[junit4:junit4]   2> 199466 T1502 oasc.SolrCore.closeSearcher [collection2] Closing main searcher on request.
[junit4:junit4]   2> 199466 T1502 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 199467 T1502 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection2 zkNodeName=127.0.0.1:49909_solr_collection2
[junit4:junit4]   2> 199468 T1502 oasc.SolrCore.close [collection3]  CLOSING SolrCore org.apache.solr.core.SolrCore@e2eaaa6
[junit4:junit4]   2> 199469 T1502 oasc.SolrCore.closeSearcher [collection3] Closing main searcher on request.
[junit4:junit4]   2> 199469 T1502 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 199470 T1502 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection3 zkNodeName=127.0.0.1:49909_solr_collection3
[junit4:junit4]   2> 199470 T1502 oasc.SolrCore.close [awholynewcollection_0]  CLOSING SolrCore org.apache.solr.core.SolrCore@36268b9d
[junit4:junit4]   2> 199471 T1502 oasc.SolrCore.closeSearcher [awholynewcollection_0] Closing main searcher on request.
[junit4:junit4]   2> 199471 T1502 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 199472 T1502 oasc.SolrCore.close [awholynewcollection_1]  CLOSING SolrCore org.apache.solr.core.SolrCore@169e5808
[junit4:junit4]   2> 199474 T1502 oasc.SolrCore.closeSearcher [awholynewcollection_1] Closing main searcher on request.
[junit4:junit4]   2> 199475 T1502 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 199582 T1615 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:49896
[junit4:junit4]   2> 200743 T1560 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 200743 T1502 oaz.ZooKeeper.close Session: 0x138b46f9d420005 closed
[junit4:junit4]   2> 200744 T1502 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 200798 T1502 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   2> 204319 T1108 oaz.ClientCnxn$SendThread.run Client session timed out, have not heard from server in 13099ms for sessionid 0x138b46ceee60010, closing socket connection and attempting reconnect
[junit4:junit4]   2> 205577 T1108 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:58825
[junit4:junit4]   2> 207894 T1616 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 207894 T1502 oaz.ZooKeeper.close Session: 0x138b46f9d420006 closed
[junit4:junit4]   1>               "roles":"none",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"oneInstanceCollection4",
[junit4:junit4]   1>               "collection":"oneInstanceCollection",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49901_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49901/solr"}}},
[junit4:junit4]   1>         "awholynewcollection_0":{
[junit4:junit4]   1>           "shard1":{"127.0.0.1:49909_solr_awholynewcollection_0":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"awholynewcollection_0",
[junit4:junit4]   1>               "collection":"awholynewcollection_0",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49909_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49909/solr"}},
[junit4:junit4]   1>           "shard2":{"127.0.0.1:49901_solr_awholynewcollection_0":{
[junit4:junit4]   1>               "shard":"shard2",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"awholynewcollection_0",
[junit4:junit4]   1>               "collection":"awholynewcollection_0",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49901_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49901/solr"}},
[junit4:junit4]   1>           "shard3":{"127.0.0.1:49899_solr_awholynewcollection_0":{
[junit4:junit4]   1>               "shard":"shard3",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"awholynewcollection_0",
[junit4:junit4]   1>               "collection":"awholynewcollection_0",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49899_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49899/solr"}},
[junit4:junit4]   1>           "shard4":{"127.0.0.1:49904_solr_awholynewcollection_0":{
[junit4:junit4]   1>               "shard":"shard4",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"awholynewcollection_0",
[junit4:junit4]   1>               "collection":"awholynewcollection_0",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49904_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49904/solr"}}},
[junit4:junit4]   1>         "control_collection":{"control_shard":{"127.0.0.1:49899_solr_collection1":{
[junit4:junit4]   1>               "shard":"control_shard",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"control_collection",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49899_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49899/solr"}}},
[junit4:junit4]   1>         "oneInstanceCollection2":{
[junit4:junit4]   1>           "slice2":{
[junit4:junit4]   1>             "127.0.0.1:49901_solr_oneInstanceCollection22":{
[junit4:junit4]   1>               "shard":"slice2",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":"none",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"oneInstanceCollection22",
[junit4:junit4]   1>               "collection":"oneInstanceCollection2",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49901_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49901/solr"},
[junit4:junit4]   1>             "127.0.0.1:49901_solr_oneInstanceCollection23":{
[junit4:junit4]   1>               "shard":"slice2",
[junit4:junit4]   1>               "roles":"none",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"oneInstanceCollection23",
[junit4:junit4]   1>               "collection":"oneInstanceCollection2",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49901_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49901/solr"}},
[junit4:junit4]   1>           "slice1":{
[junit4:junit4]   1>             "127.0.0.1:49901_solr_oneInstanceCollection24":{
[junit4:junit4]   1>               "shard":"slice1",
[junit4:junit4]   1>               "roles":"none",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"oneInstanceCollection24",
[junit4:junit4]   1>               "collection":"oneInstanceCollection2",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49901_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49901/solr"},
[junit4:junit4]   1>             "127.0.0.1:49901_solr_oneInstanceCollection21":{
[junit4:junit4]   1>               "shard":"slice1",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":"none",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"oneInstanceCollection21",
[junit4:junit4]   1>               "collection":"oneInstanceCollection2",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49901_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49901/solr"}}},
[junit4:junit4]   1>         "awholynewcollection_1":{
[junit4:junit4]   1>           "shard1":{"127.0.0.1:49909_solr_awholynewcollection_1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"awholynewcollection_1",
[junit4:junit4]   1>               "collection":"awholynewcollection_1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:49909_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:49909/solr"}},
[junit4:junit4]   1>           "shard2":{}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=AF27CBE78E432BDD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=uk -Dtests.timezone=Australia/North -Dtests.file.encoding=UTF-8
[junit4:junit4]   1>
[junit4:junit4]   2>
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 207926 T1502 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=PostingsFormat(name=MockSep), foo_b=Pulsing40(freqCutoff=20 minBlockSize=69 maxBlockSize=142), cat=MockVariableIntBlock(baseBlockSize=106), foo_d=Pulsing40(freqCutoff=15 minBlockSize=69 maxBlockSize=142), foo_f=Pulsing40(freqCutoff=20 minBlockSize=69 maxBlockSize=142), n_tl1=PostingsFormat(name=MockSep), n_d1=MockVariableIntBlock(baseBlockSize=106), rnd_b=Pulsing40(freqCutoff=15 minBlockSize=69 maxBlockSize=142), intDefault=MockVariableIntBlock(baseBlockSize=106), n_td1=PostingsFormat(name=MockSep), id=Pulsing40(freqCutoff=15 minBlockSize=69 maxBlockSize=142), timestamp=MockVariableIntBlock(baseBlockSize=106), range_facet_sl=Pulsing40(freqCutoff=20 minBlockSize=69 maxBlockSize=142), range_facet_si=PostingsFormat(name=MockSep), oddField_s=Pulsing40(freqCutoff=20 minBlockSize=69 maxBlockSize=142), sequence_i=Pulsing40(freqCutoff=20 minBlockSize=69 maxBlockSize=142), name=Pulsing40(freqCutoff=15 minBlockSize=69 maxBlockSize=142), foo_i=PostingsFormat(name=MockSep), regex_dup_B_s=MockVariableIntBlock(baseBlockSize=106), multiDefault=PostingsFormat(name=MockSep), n_tf1=MockVariableIntBlock(baseBlockSize=106), n_dt1=PostingsFormat(name=MockSep), genre_s=Pulsing40(freqCutoff=20 minBlockSize=69 maxBlockSize=142), author_t=PostingsFormat(name=MockSep), n_ti1=Pulsing40(freqCutoff=15 minBlockSize=69 maxBlockSize=142), range_facet_l=MockVariableIntBlock(baseBlockSize=106), text=Pulsing40(freqCutoff=20 minBlockSize=69 maxBlockSize=142), _version_=MockVariableIntBlock(baseBlockSize=106), val_i=Pulsing40(freqCutoff=15 minBlockSize=69 maxBlockSize=142), SubjectTerms_mfacet=MockVariableIntBlock(baseBlockSize=106), series_t=PostingsFormat(name=MockSep), a_t=MockVariableIntBlock(baseBlockSize=106), n_tdt1=MockVariableIntBlock(baseBlockSize=106), regex_dup_A_s=Pulsing40(freqCutoff=20 minBlockSize=69 maxBlockSize=142), price=Pulsing40(freqCutoff=20 minBlockSize=69 maxBlockSize=142), other_tl1=MockVariableIntBlock(baseBlockSize=106), n_l1=MockVariableIntBlock(baseBlockSize=106), a_si=PostingsFormat(name=MockSep), inStock=Pulsing40(freqCutoff=20 minBlockSize=69 maxBlockSize=142)}, sim=RandomSimilarityProvider(queryNorm=false,coord=false): {}, locale=uk, timezone=Australia/North
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=3,free=169731224,total=434110464
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestStressLucene, TestShingleFilterFactory, TestWikipediaTokenizerFactory, TestSystemIdResolver, TestKeepFilterFactory, TestIBSimilarityFactory, DocumentBuilderTest, TestMultiWordSynonyms, TestSolrDeletionPolicy2, TestRealTimeGet, TimeZoneUtilsTest, TestPatternReplaceFilterFactory, FileBasedSpellCheckerTest, PeerSyncTest, TestNGramFilters, TestCollationField, TestPersianNormalizationFilterFactory, SortByFunctionTest, SpellCheckCollatorTest, TestXIncludeConfig, TestHungarianLightStemFilterFactory, UpdateParamsTest, DebugComponentTest, TestHindiFilters, ZkCLITest, TestQueryTypes, TestQuerySenderNoQuery, SolrCoreTest, TestGermanNormalizationFilterFactory, ZkControllerTest, TestCoreContainer, ZkSolrClientTest, TestJapaneseReadingFormFilterFactory, StandardRequestHandlerTest, TestGermanMinimalStemFilterFactory, TestTurkishLowerCaseFilterFactory, SpellCheckComponentTest, TestOmitPositions, TestDocSet, HighlighterConfigTest, TestGroupingSearch, TestLRUCache, TestGalicianMinimalStemFilterFactory, CloudStateTest, TestBinaryResponseWriter, TestWriterPerf, IndexSchemaTest, AlternateDirectoryTest, FieldMutatingUpdateProcessorTest, FullSolrCloudTest, TestKeywordMarkerFilterFactory, LeaderElectionTest, LengthFilterTest, TestLMDirichletSimilarityFactory, FieldAnalysisRequestHandlerTest, TestLuceneMatchVersion, CommonGramsFilterFactoryTest, DirectSolrConnectionTest, TestIndonesianStemFilterFactory, TestBeiderMorseFilterFactory, TestJmxMonitoredMap, TestSuggestSpellingConverter, WordBreakSolrSpellCheckerTest, TestFastLRUCache, SoftAutoCommitTest, TestNumberUtils, DistributedTermsComponentTest, TestArbitraryIndexDir, ReturnFieldsTest, RAMDirectoryFactoryTest, TestReload, BasicDistributedZkTest]
[junit4:junit4]   2>
[junit4:junit4] Completed on J1 in 208.02s, 1 test, 1 failure <<< FAILURES!
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4:junit4] Completed on J1 in 43.22s, 1 test
[junit4:junit4]  
[junit4:junit4] HEARTBEAT J0: 2012-07-23T15:28:04, no events in: 69.9s, approx. at: OverseerTest.testStateChange
[junit4:junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4:junit4] Completed on J1 in 51.65s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4:junit4]    > (@BeforeClass output)
[junit4:junit4]   2> 1 T537 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test/J0/./solrtest-OverseerTest-1343057179834
[junit4:junit4]   2> 1 T537 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2>
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 33233 T537 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> 33233 T537 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2> 33233 T537 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 33484 T1045 oasc.Overseer$CloudStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:289)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:286)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:286)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.amILeader(Overseer.java:187)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 33484 T1045 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88018597410045955-127.0.0.1:60346_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 34168 T1034 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 34168 T739 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 154358 T537 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=0 closes=1
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {}, sim=DefaultSimilarity, locale=th, timezone=Asia/Dili
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=21,free=111917688,total=318767104
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestSolrCoreProperties, TestBinaryField, TestSolrQueryParser, UpdateRequestProcessorFactoryTest, SolrRequestParserTest, DOMUtilTest, OutputWriterTest, HighlighterTest, CacheHeaderTest, TestFrenchLightStemFilterFactory, TestWordDelimiterFilterFactory, TestPHPSerializedResponseWriter, SolrInfoMBeanTest, TestGermanStemFilterFactory, TestUpdate, TestCSVLoader, TestPortugueseMinimalStemFilterFactory, LeaderElectionIntegrationTest, TestTypeTokenFilterFactory, TestStandardFactories, DateMathParserTest, MinimalSchemaTest, TestPropInject, TestJoin, DoubleMetaphoneFilterFactoryTest, TestIndexingPerformance, StatelessScriptUpdateProcessorFactoryTest, PluginInfoTest, BasicFunctionalityTest, CommonGramsQueryFilterFactoryTest, AutoCommitTest, SuggesterTest, TestDistributedSearch, SOLR749Test, TestBM25SimilarityFactory, TestSynonymFilterFactory, TestMappingCharFilterFactory, TestThaiWordFilterFactory, TermsComponentTest, TestFinnishLightStemFilterFactory, TestFiltering, TestPatternReplaceCharFilterFactory, QueryElevationComponentTest, TestFrenchMinimalStemFilterFactory, TestTrimFilterFactory, TestRemoveDuplicatesTokenFilterFactory, EchoParamsTest, TestGreekLowerCaseFilterFactory, ZkNodePropsTest, ShowFileRequestHandlerTest, TestHTMLStripCharFilterFactory, TestStressRecovery, TestMergePolicyConfig, DirectUpdateHandlerOptimizeTest, XmlUpdateRequestHandlerTest, SolrCoreCheckLockOnStartupTest, TestPatternTokenizerFactory, SystemInfoHandlerTest, TestPortugueseStemFilterFactory, TestDelimitedPayloadTokenFilterFactory, SolrIndexConfigTest, TestBulgarianStemFilterFactory, MoreLikeThisHandlerTest, TestDFRSimilarityFactory, RequiredFieldsTest, TestCJKWidthFilterFactory, SyncSliceTest, TestSearchPerf, TestJapanesePartOfSpeechStopFilterFactory, CurrencyFieldTest, TestSwedishLightStemFilterFactory, TestNorwegianLightStemFilterFactory, OverseerTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest -Dtests.seed=AF27CBE78E432BDD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=Asia/Dili -Dtests.file.encoding=UTF-8
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | OverseerTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=0 closes=1
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([AF27CBE78E432BDD]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 154.38s, 8 tests, 1 failure <<< FAILURES!
[...truncated 457 lines...]

[...truncated 27470 lines...]

[...truncated 27470 lines...]

[...truncated 27470 lines...]

[...truncated 27470 lines...]

[...truncated 10276 lines...]
[junit4:junit4]   2> 162200 T433 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=24 closes=23
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {range_facet_l=MockVariableIntBlock(baseBlockSize=60), text=Pulsing40(freqCutoff=10 minBlockSize=32 maxBlockSize=82), _version_=MockVariableIntBlock(baseBlockSize=60), rnd_b=PostingsFormat(name=Memory doPackFST= false), intDefault=MockVariableIntBlock(baseBlockSize=60), id=PostingsFormat(name=Memory doPackFST= false), timestamp=MockVariableIntBlock(baseBlockSize=60), a_t=PostingsFormat(name=SimpleText), range_facet_sl=PostingsFormat(name=Memory doPackFST= false), range_facet_si=PostingsFormat(name=SimpleText), other_tl1=MockVariableIntBlock(baseBlockSize=60), multiDefault=MockVariableIntBlock(baseBlockSize=60), a_si=MockVariableIntBlock(baseBlockSize=60)}, sim=RandomSimilarityProvider(queryNorm=true,coord=true): {}, locale=sk, timezone=America/Rosario
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=6,free=190428872,total=318767104
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestSolrCoreProperties, TestBinaryField, TestSolrQueryParser, UpdateRequestProcessorFactoryTest, SolrRequestParserTest, DOMUtilTest, OutputWriterTest, HighlighterTest, CacheHeaderTest, TestFrenchLightStemFilterFactory, TestWordDelimiterFilterFactory, TestPHPSerializedResponseWriter, SolrInfoMBeanTest, TestGermanStemFilterFactory, TestUpdate, TestCSVLoader, TestPortugueseMinimalStemFilterFactory, LeaderElectionIntegrationTest, TestTypeTokenFilterFactory, TestStandardFactories, DateMathParserTest, MinimalSchemaTest, TestPropInject, TestJoin, DoubleMetaphoneFilterFactoryTest, TestIndexingPerformance, StatelessScriptUpdateProcessorFactoryTest, PluginInfoTest, BasicFunctionalityTest, CommonGramsQueryFilterFactoryTest, AutoCommitTest, SuggesterTest, TestDistributedSearch, SOLR749Test, TestBM25SimilarityFactory, TestSynonymFilterFactory, TestMappingCharFilterFactory, TestThaiWordFilterFactory, TermsComponentTest, TestFinnishLightStemFilterFactory, TestFiltering, TestPatternReplaceCharFilterFactory, QueryElevationComponentTest, TestFrenchMinimalStemFilterFactory, TestTrimFilterFactory, TestRemoveDuplicatesTokenFilterFactory, EchoParamsTest, TestGreekLowerCaseFilterFactory, ZkNodePropsTest, ShowFileRequestHandlerTest, TestHTMLStripCharFilterFactory, TestStressRecovery, TestMergePolicyConfig, DirectUpdateHandlerOptimizeTest, XmlUpdateRequestHandlerTest, SolrCoreCheckLockOnStartupTest, TestPatternTokenizerFactory, SystemInfoHandlerTest, TestPortugueseStemFilterFactory, TestDelimitedPayloadTokenFilterFactory, SolrIndexConfigTest, TestBulgarianStemFilterFactory, MoreLikeThisHandlerTest, TestDFRSimilarityFactory, RequiredFieldsTest, TestCJKWidthFilterFactory, SyncSliceTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.seed=AF27CBE78E432BDD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sk -Dtests.timezone=America/Rosario -Dtests.file.encoding=UTF-8
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | SyncSliceTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=24 closes=23
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([AF27CBE78E432BDD]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 162.25s, 1 test, 1 failure <<< FAILURES!
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSearchPerf
[junit4:junit4] Completed on J0 in 0.54s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapanesePartOfSpeechStopFilterFactory
[junit4:junit4] Completed on J0 in 0.36s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.CurrencyFieldTest
[junit4:junit4] IGNORED 0.00s J0 | CurrencyFieldTest.testPerformance
[junit4:junit4]    > Cause: Annotated @Ignore()
[junit4:junit4] Completed on J0 in 1.35s, 8 tests, 1 skipped
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestSwedishLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestNorwegianLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4] FAILURE  208s J1 | BasicDistributedZkTest.testDistribSearch
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: Could not find new 4 slice collection called awholynewcollection_4
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([AF27CBE78E432BDD:2EC145FFF91C4BE1]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.cloud.BasicDistributedZkTest.checkForCollection(BasicDistributedZkTest.java:570)
[junit4:junit4]    > at org.apache.solr.cloud.BasicDistributedZkTest.testCollectionsAPI(BasicDistributedZkTest.java:351)
[junit4:junit4]    > at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:309)
[junit4:junit4]    > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4]   2> 3 T1502 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZkTest-1343057009982
[junit4:junit4]   2> 3 T1502 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 6 T1503 oazs.ZooKeeperServer.setTickTime tickTime set to 3000
[junit4:junit4]   2> 6 T1503 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 7 T1503 oazsp.FileTxnSnapLog.save Snapshotting: 0
[junit4:junit4]   2> 105 T1502 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49896 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4759d78d
[junit4:junit4]   2> 106 T1508 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:49896
[junit4:junit4]   2> 107 T1508 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49896, initiating session
[junit4:junit4]   2> 107 T1504 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:49897
[junit4:junit4]   2> 107 T1504 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:49897
[junit4:junit4]   2> 107 T1506 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 109 T1506 oazs.NIOServerCnxn.finishSessionInit Established session 0x138b46f9d420000 with negotiated timeout 10000 for client /140.211.11.196:49897
[junit4:junit4]   2> 110 T1508 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:49896, sessionid = 0x138b46f9d420000, negotiated timeout = 10000
[junit4:junit4]   2> 110 T1509 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4759d78d name:ZooKeeperConnection Watcher:127.0.0.1:49896 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 110 T1502 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 112 T1507 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x138b46f9d420000
[junit4:junit4]   2> 120 T1509 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 120 T1504 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:49897 which had sessionid 0x138b46f9d420000
[junit4:junit4]   2> 120 T1502 oaz.ZooKeeper.close Session: 0x138b46f9d420000 closed
[junit4:junit4]   2> 121 T1502 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49896/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@42bbde78
[junit4:junit4]   2> 121 T1510 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:49896
[junit4:junit4]   2> 122 T1510 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49896, initiating session
[junit4:junit4]   2> 122 T1504 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:49898
[junit4:junit4]   2> 122 T1504 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:49898
[junit4:junit4]   2> 123 T1506 oazs.NIOServerCnxn.finishSessionInit Established session 0x138b46f9d420001 with negotiated timeout 10000 for client /140.211.11.196:49898
[junit4:junit4]   2> 123 T1510 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:49896, sessionid = 0x138b46f9d420001, negotiated timeout = 10000
[junit4:junit4]   2> 124 T1511 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42bbde78 name:ZooKeeperConnection Watcher:127.0.0.1:49896/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 124 T1502 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 135 T1502 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 137 T1502 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 139 T1502 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 147 T1502 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 156 T1502 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 259 T1502 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 262 T1502 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 272 T1502 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 274 T1502 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 277 T1502 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 284 T1502 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 288 T1502 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 290 T1502 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 299 T1507 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x138b46f9d420001
[junit4:junit4]   2> 300 T1511 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 300 T1504 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:49898 which had sessionid 0x138b46f9d420001
[junit4:junit4]   2> 300 T1502 oaz.ZooKeeper.close Session: 0x138b46f9d420001 closed
[junit4:junit4]   2> 366 T1502 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 369 T1502 oejs.AbstractConnector.doStart Started SocketConnector@0.0.0.0:49899
[junit4:junit4]   2> 369 T1502 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 370 T1502 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1
[junit4:junit4]   2> 370 T1502 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/'
[junit4:junit4]   2> 375 T1502 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 376 T1502 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 376 T1502 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1
[junit4:junit4]   2> 376 T1502 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/solr.xml
[junit4:junit4]   2> 376 T1502 oasc.CoreContainer.<init> New CoreContainer 1173327388
[junit4:junit4]   2> 377 T1502 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/'
[junit4:junit4]   2> 377 T1502 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/'
[junit4:junit4]   2> 386 T1502 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 401 T1502 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49896/solr
[junit4:junit4]   2> 401 T1502 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49896/solr sessionTimeout=12000 watcher=org.apache.solr.common.cloud.ConnectionManager@725af422
[junit4:junit4]   2> 402 T1521 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:49896
[junit4:junit4]   2> 403 T1521 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49896, initiating session
[junit4:junit4]   2> 403 T1504 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:49900
[junit4:junit4]   2> 403 T1504 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:49900
[junit4:junit4]   2> 405 T1506 oazs.NIOServerCnxn.finishSessionInit Established session 0x138b46f9d420002 with negotiated timeout 12000 for client /140.211.11.196:49900
[junit4:junit4]   2> 405 T1521 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:49896, sessionid = 0x138b46f9d420002, negotiated timeout = 12000
[junit4:junit4]   2> 405 T1522 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@725af422 name:ZooKeeperConnection Watcher:127.0.0.1:49896/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 406 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420002 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 408 T1502 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 417 T1502 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49899_solr
[junit4:junit4]   2> 417 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420002 type:delete cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49899_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49899_solr
[junit4:junit4]   2> 418 T1502 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49899_solr
[junit4:junit4]   2> 421 T1502 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 421 T1502 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 421 T1502 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 421 T1502 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 422 T1502 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 422 T1502 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 422 T1502 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 422 T1502 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 423 T1502 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 423 T1502 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 433 T1502 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 444 T1502 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 446 T1502 oasc.Overseer.<init> Overseer (id=88018584206442498-127.0.0.1:49899_solr-n_0000000000) starting
[junit4:junit4]   2> 447 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420002 type:create cxid:0x19 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 452 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420002 type:create cxid:0x1a zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 453 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420002 type:create cxid:0x1b zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 455 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420002 type:create cxid:0x1c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 464 T1524 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 465 T1523 oasc.Overseer$CloudStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 465 T1502 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 468 T1502 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 474 T1502 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/collection1
[junit4:junit4]   2> 474 T1502 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 475 T1502 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 475 T1502 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 476 T1502 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/collection1/'
[junit4:junit4]   2> 477 T1502 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/collection1/lib/README' to classloader
[junit4:junit4]   2> 477 T1502 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 509 T1502 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 575 T1502 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 676 T1502 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 680 T1502 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1245 T1502 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1256 T1502 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1260 T1502 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1270 T1502 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1274 T1502 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1277 T1502 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1278 T1502 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1279 T1502 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/collection1/data/
[junit4:junit4]   2> 1280 T1502 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2dc5c9ca
[junit4:junit4]   2> 1280 T1502 oasc.SolrCore.getNewIndexDir WARNING New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/collection1/data/index/
[junit4:junit4]   2> 1281 T1502 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1349 T1502 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/control1/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@45f9f3da; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1350 T1502 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 1350 T1502 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1352 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1352 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1352 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1353 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1353 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1353 T1502 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1354 T1502 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1354 T1502 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1354 T1502 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1355 T1502 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1355 T1502 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1355 T1502 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1356 T1502 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1356 T1502 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1356 T1502 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1357 T1502 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1357 T1502 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1357 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1357 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1358 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1358 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1359 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1359 T1502 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1359 T1502 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1360 T1502 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1360 T1502 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1362 T1502 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1364 T1502 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1366 T1502 oass.SolrIndexSearcher.<init> Opening Searcher@59529c2c main
[junit4:junit4]   2> 1367 T1502 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1367 T1502 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1367 T1502 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1369 T1502 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1377 T1525 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59529c2c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1379 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420002 type:create cxid:0x52 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1473 T1502 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 1474 T1502 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:49899/solr shardId:control_shard
[junit4:junit4]   2> 1474 T1523 oascc.ZkStateReader.updateCloudState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 1474 T1502 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 1501 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420002 type:create cxid:0x61 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1616 T1522 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 1633 T1502 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 1637 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420002 type:create cxid:0x7b zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1962 T1108 oaz.ClientCnxn$SendThread.run Client session timed out, have not heard from server in 12001ms for sessionid 0x138b46ceee60010, closing socket connection and attempting reconnect
[junit4:junit4]   2> 2129 T1523 oascc.ZkStateReader.updateCloudState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2148 T1522 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 2201 T1502 oasc.ZkController.register We are http://127.0.0.1:49899/solr/collection1/ and leader is http://127.0.0.1:49899/solr/collection1/
[junit4:junit4]   2> 2201 T1502 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49899/solr
[junit4:junit4]   2> 2202 T1502 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 2204 T1502 oascc.ZkStateReader.updateCloudState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2205 T1502 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test/J1
[junit4:junit4]   2> 2205 T1502 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 2206 T1502 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 2309 T1502 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 2312 T1502 oejs.AbstractConnector.doStart Started SocketConnector@0.0.0.0:49901
[junit4:junit4]   2> 2313 T1502 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2314 T1502 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2
[junit4:junit4]   2> 2314 T1502 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/'
[junit4:junit4]   2> 2324 T1502 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2325 T1502 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2326 T1502 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2
[junit4:junit4]   2> 2326 T1502 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/solr.xml
[junit4:junit4]   2> 2327 T1502 oasc.CoreContainer.<init> New CoreContainer 1185618761
[junit4:junit4]   2> 2327 T1502 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/'
[junit4:junit4]   2> 2328 T1502 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/'
[junit4:junit4]   2> 2347 T1502 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2377 T1502 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49896/solr
[junit4:junit4]   2> 2377 T1502 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49896/solr sessionTimeout=12000 watcher=org.apache.solr.common.cloud.ConnectionManager@b8c79de
[junit4:junit4]   2> 2378 T1535 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:49896
[junit4:junit4]   2> 2379 T1535 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49896, initiating session
[junit4:junit4]   2> 2379 T1504 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:49902
[junit4:junit4]   2> 2380 T1504 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:49902
[junit4:junit4]   2> 2381 T1506 oazs.NIOServerCnxn.finishSessionInit Established session 0x138b46f9d420003 with negotiated timeout 12000 for client /140.211.11.196:49902
[junit4:junit4]   2> 2381 T1535 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:49896, sessionid = 0x138b46f9d420003, negotiated timeout = 12000
[junit4:junit4]   2> 2382 T1536 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b8c79de name:ZooKeeperConnection Watcher:127.0.0.1:49896/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2382 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420003 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2383 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420003 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2391 T1502 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49901_solr
[junit4:junit4]   2> 2391 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420003 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49901_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49901_solr
[junit4:junit4]   2> 2392 T1502 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49901_solr
[junit4:junit4]   2> 2394 T1522 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 2395 T1502 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 2395 T1502 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2395 T1502 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 2396 T1502 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2396 T1502 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2397 T1502 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2397 T1502 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2397 T1502 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2398 T1502 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2398 T1502 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 2413 T1502 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 2422 T1502 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/collection1
[junit4:junit4]   2> 2422 T1502 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2423 T1502 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2423 T1502 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2424 T1502 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/collection1/'
[junit4:junit4]   2> 2425 T1502 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/collection1/lib/README' to classloader
[junit4:junit4]   2> 2425 T1502 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2473 T1502 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2572 T1502 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2663 T1523 oascc.ZkStateReader.updateCloudState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2673 T1502 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2677 T1522 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 2677 T1536 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 2680 T1502 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3419 T1108 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server localhost/127.0.0.1:58825
[junit4:junit4]   2> 3494 T1502 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3504 T1502 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3510 T1502 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3523 T1502 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3529 T1502 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3533 T1502 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3535 T1502 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3536 T1502 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/collection1/data/
[junit4:junit4]   2> 3536 T1502 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2dc5c9ca
[junit4:junit4]   2> 3537 T1502 oasc.SolrCore.getNewIndexDir WARNING New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/collection1/data/index/
[junit4:junit4]   2> 3538 T1502 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3542 T1502 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty2/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@33571907; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3542 T1502 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 3543 T1502 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3544 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3545 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3545 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3546 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3547 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3547 T1502 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3547 T1502 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3548 T1502 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3548 T1502 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3549 T1502 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3550 T1502 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3550 T1502 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3551 T1502 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3551 T1502 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3551 T1502 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3552 T1502 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3552 T1502 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3553 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3553 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3554 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3554 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3555 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3555 T1502 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3556 T1502 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3557 T1502 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3558 T1502 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3560 T1502 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3561 T1502 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3565 T1502 oass.SolrIndexSearcher.<init> Opening Searcher@6b7f37aa main
[junit4:junit4]   2> 3566 T1502 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3566 T1502 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3567 T1502 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3569 T1502 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3579 T1537 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6b7f37aa main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3583 T1502 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 3583 T1502 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:49901/solr shardId:shard3
[junit4:junit4]   2> 3584 T1502 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4]   2> 3606 T1502 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4]   2> 3620 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420003 type:create cxid:0x4a zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3684 T1523 oascc.ZkStateReader.updateCloudState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3712 T1522 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 3712 T1536 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 3729 T1502 oasc.ZkController.register We are http://127.0.0.1:49901/solr/collection1/ and leader is http://127.0.0.1:49901/solr/collection1/
[junit4:junit4]   2> 3729 T1502 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49901/solr
[junit4:junit4]   2> 3729 T1502 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3735 T1502 oascc.ZkStateReader.updateCloudState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3736 T1502 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3736 T1502 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3736 T1502 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3827 T1502 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 3830 T1502 oejs.AbstractConnector.doStart Started SocketConnector@0.0.0.0:49904
[junit4:junit4]   2> 3830 T1502 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3831 T1502 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3
[junit4:junit4]   2> 3831 T1502 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/'
[junit4:junit4]   2> 3838 T1502 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3839 T1502 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3839 T1502 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3
[junit4:junit4]   2> 3839 T1502 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/solr.xml
[junit4:junit4]   2> 3840 T1502 oasc.CoreContainer.<init> New CoreContainer 832905386
[junit4:junit4]   2> 3840 T1502 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/'
[junit4:junit4]   2> 3841 T1502 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/'
[junit4:junit4]   2> 3853 T1502 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3871 T1502 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49896/solr
[junit4:junit4]   2> 3871 T1502 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49896/solr sessionTimeout=12000 watcher=org.apache.solr.common.cloud.ConnectionManager@5003925c
[junit4:junit4]   2> 3872 T1547 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:49896
[junit4:junit4]   2> 3873 T1547 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49896, initiating session
[junit4:junit4]   2> 3873 T1504 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /140.211.11.196:49905
[junit4:junit4]   2> 3873 T1504 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /140.211.11.196:49905
[junit4:junit4]   2> 3876 T1506 oazs.NIOServerCnxn.finishSessionInit Established session 0x138b46f9d420004 with negotiated timeout 12000 for client /140.211.11.196:49905
[junit4:junit4]   2> 3876 T1547 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server localhost/127.0.0.1:49896, sessionid = 0x138b46f9d420004, negotiated timeout = 12000
[junit4:junit4]   2> 3876 T1548 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5003925c name:ZooKeeperConnection Watcher:127.0.0.1:49896/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3877 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420004 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3878 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420004 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3887 T1502 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49904_solr
[junit4:junit4]   2> 3888 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420004 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:49904_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:49904_solr
[junit4:junit4]   2> 3889 T1502 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49904_solr
[junit4:junit4]   2> 3892 T1522 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 3892 T1536 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 3893 T1502 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3893 T1502 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3893 T1502 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3893 T1502 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3894 T1502 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3894 T1502 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3895 T1502 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3895 T1502 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3896 T1502 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3896 T1502 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3911 T1502 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 3918 T1502 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/collection1
[junit4:junit4]   2> 3919 T1502 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3920 T1502 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3920 T1502 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3921 T1502 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/collection1/'
[junit4:junit4]   2> 3922 T1502 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/collection1/lib/README' to classloader
[junit4:junit4]   2> 3922 T1502 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3953 T1502 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 4021 T1502 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4123 T1502 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4127 T1502 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4236 T1523 oascc.ZkStateReader.updateCloudState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 4242 T1522 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 4242 T1536 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 4242 T1548 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 4697 T1502 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4705 T1502 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4709 T1502 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4720 T1502 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4724 T1502 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4728 T1502 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4729 T1502 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4730 T1502 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/collection1/data/
[junit4:junit4]   2> 4730 T1502 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2dc5c9ca
[junit4:junit4]   2> 4731 T1502 oasc.SolrCore.getNewIndexDir WARNING New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/collection1/data/index/
[junit4:junit4]   2> 4732 T1502 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/collection1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4759 T1502 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build/solr-core/test-files/jetty3/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@23a9f3b4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4760 T1502 oasc.SolrDeletionPolicy.updateCommits newest commit = 1
[junit4:junit4]   2> 4760 T1502 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4761 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4762 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4762 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4762 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4763 T1502 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4763 T1502 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4763 T1502 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4764 T1502 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4764 T1502 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4764 T1502 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4765 T1502 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4765 T1502 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4765 T1502 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4766 T1502 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4766 T1502 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4766 T1502 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4767 T1502 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4767 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4767 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4768 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4768 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4769 T1502 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4769 T1502 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4769 T1502 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4770 T1502 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4770 T1502 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4772 T1502 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4773 T1502 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4776 T1502 oass.SolrIndexSearcher.<init> Opening Searcher@db2c8e1 main
[junit4:junit4]   2> 4777 T1502 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4777 T1502 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4777 T1502 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4779 T1502 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4786 T1549 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@db2c8e1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4789 T1502 oasc.CoreContainer.register registering core: collection1
[junit4:junit4]   2> 4790 T1502 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:49904/solr shardId:shard4
[junit4:junit4]   2> 4790 T1502 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard4/election
[junit4:junit4]   2> 4803 T1502 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard4
[junit4:junit4]   2> 4814 T1507 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x138b46f9d420004 type:create cxid:0x48 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5254 T1523 oascc.ZkStateReader.updateCloudState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 5280 T1522 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 5280 T1548 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 5280 T1536 oascc.ZkStateReader$2.process A cluster state change has occurred
[junit4:junit4]   2> 5331 T1502 oasc.ZkController.register We are http://127.0.0.1:49904/solr/collection1/ and leader is http://127.0.0.1:49904/solr/collection1/
[junit4:junit4]   2> 5331 T1502 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49904/solr
[...truncated 16194 lines...]
[junit4:junit4]   2> 154358 T537 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=0 closes=1
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {}, sim=DefaultSimilarity, locale=th, timezone=Asia/Dili
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=21,free=111917688,total=318767104
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestSolrCoreProperties, TestBinaryField, TestSolrQueryParser, UpdateRequestProcessorFactoryTest, SolrRequestParserTest, DOMUtilTest, OutputWriterTest, HighlighterTest, CacheHeaderTest, TestFrenchLightStemFilterFactory, TestWordDelimiterFilterFactory, TestPHPSerializedResponseWriter, SolrInfoMBeanTest, TestGermanStemFilterFactory, TestUpdate, TestCSVLoader, TestPortugueseMinimalStemFilterFactory, LeaderElectionIntegrationTest, TestTypeTokenFilterFactory, TestStandardFactories, DateMathParserTest, MinimalSchemaTest, TestPropInject, TestJoin, DoubleMetaphoneFilterFactoryTest, TestIndexingPerformance, StatelessScriptUpdateProcessorFactoryTest, PluginInfoTest, BasicFunctionalityTest, CommonGramsQueryFilterFactoryTest, AutoCommitTest, SuggesterTest, TestDistributedSearch, SOLR749Test, TestBM25SimilarityFactory, TestSynonymFilterFactory, TestMappingCharFilterFactory, TestThaiWordFilterFactory, TermsComponentTest, TestFinnishLightStemFilterFactory, TestFiltering, TestPatternReplaceCharFilterFactory, QueryElevationComponentTest, TestFrenchMinimalStemFilterFactory, TestTrimFilterFactory, TestRemoveDuplicatesTokenFilterFactory, EchoParamsTest, TestGreekLowerCaseFilterFactory, ZkNodePropsTest, ShowFileRequestHandlerTest, TestHTMLStripCharFilterFactory, TestStressRecovery, TestMergePolicyConfig, DirectUpdateHandlerOptimizeTest, XmlUpdateRequestHandlerTest, SolrCoreCheckLockOnStartupTest, TestPatternTokenizerFactory, SystemInfoHandlerTest, TestPortugueseStemFilterFactory, TestDelimitedPayloadTokenFilterFactory, SolrIndexConfigTest, TestBulgarianStemFilterFactory, MoreLikeThisHandlerTest, TestDFRSimilarityFactory, RequiredFieldsTest, TestCJKWidthFilterFactory, SyncSliceTest, TestSearchPerf, TestJapanesePartOfSpeechStopFilterFactory, CurrencyFieldTest, TestSwedishLightStemFilterFactory, TestNorwegianLightStemFilterFactory, OverseerTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest -Dtests.seed=AF27CBE78E432BDD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=Asia/Dili -Dtests.file.encoding=UTF-8
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | OverseerTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=0 closes=1
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([AF27CBE78E432BDD]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 154.38s, 8 tests, 1 failure <<< FAILURES!
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4:junit4] Completed on J1 in 30.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.DistributedSpellCheckComponentTest
[junit4:junit4] Completed on J0 in 12.06s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestDistributedGrouping
[junit4:junit4] Completed on J1 in 15.15s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.CloudStateUpdateTest
[junit4:junit4] Completed on J1 in 9.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestExtendedDismaxParser
[junit4:junit4] Completed on J1 in 9.22s, 10 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.BasicZkTest
[junit4:junit4] Completed on J1 in 14.49s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPhoneticFilterFactory
[junit4:junit4] Completed on J1 in 12.32s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.TestFaceting
[junit4:junit4] Completed on J1 in 11.88s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestRandomFaceting
[junit4:junit4] Completed on J0 in 73.86s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.TestHashPartitioner
[junit4:junit4] Completed on J1 in 8.98s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.StatsComponentTest
[junit4:junit4] Completed on J0 in 6.82s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.IndexBasedSpellCheckerTest
[junit4:junit4] Completed on J0 in 1.11s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestRecovery
[junit4:junit4] Completed on J1 in 11.12s, 9 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.DirectUpdateHandlerTest
[junit4:junit4] Completed on J1 in 3.37s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.TestMultiCoreConfBootstrap
[junit4:junit4] Completed on J1 in 3.55s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestRangeQuery
[junit4:junit4] Completed on J0 in 7.94s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.SimpleFacetsTest
[junit4:junit4] Completed on J1 in 5.24s, 30 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.admin.LukeRequestHandlerTest
[junit4:junit4] Completed on J0 in 2.68s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.DirectSolrSpellCheckerTest
[junit4:junit4] Completed on J0 in 1.07s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSort
[junit4:junit4] Completed on J1 in 4.79s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest
[junit4:junit4] Completed on J1 in 1.37s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.ConvertedLegacyTest
[junit4:junit4] Completed on J0 in 2.91s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.SampleTest
[junit4:junit4] Completed on J0 in 0.39s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestJmxIntegration
[junit4:junit4] IGNORED 0.00s J1 | TestJmxIntegration.testJmxOnCoreReload
[junit4:junit4]    > Cause: Annotated @Ignore(timing problem? https://issues.apache.org/jira/browse/SOLR-2715)
[junit4:junit4] Completed on J1 in 1.54s, 3 tests, 1 skipped
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestIndexSearcher
[junit4:junit4] Completed on J0 in 2.20s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.admin.CoreAdminHandlerTest
[junit4:junit4] Completed on J1 in 1.61s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestTrie
[junit4:junit4] Completed on J1 in 2.08s, 8 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.TestRemoteStreaming
[junit4:junit4] Completed on J1 in 0.97s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.function.TestFunctionQuery
[junit4:junit4] Completed on J0 in 3.47s, 14 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.QueryEqualityTest
[junit4:junit4] Completed on J1 in 1.15s, 58 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.PolyFieldTest
[junit4:junit4] Completed on J0 in 1.42s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.response.TestCSVResponseWriter
[junit4:junit4] Completed on J0 in 0.97s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.SpatialFilterTest
[junit4:junit4] Completed on J1 in 1.90s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.admin.MBeansHandlerTest
[junit4:junit4] Completed on J0 in 1.12s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.DistributedQueryElevationComponentTest
[junit4:junit4] Completed on J1 in 2.37s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestPseudoReturnFields
[junit4:junit4] Completed on J0 in 1.80s, 13 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.DisMaxRequestHandlerTest
[junit4:junit4] Completed on J1 in 1.09s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.BinaryUpdateRequestHandlerTest
[junit4:junit4] Completed on J0 in 1.13s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.QueryParsingTest
[junit4:junit4] Completed on J1 in 0.84s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.function.distance.DistanceFunctionTest
[junit4:junit4] Completed on J0 in 1.21s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.XsltUpdateRequestHandlerTest
[junit4:junit4] Completed on J1 in 1.07s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.PingRequestHandlerTest
[junit4:junit4] Completed on J0 in 0.97s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.TermVectorComponentTest
[junit4:junit4] Completed on J1 in 1.24s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.JsonLoaderTest
[junit4:junit4] Completed on J1 in 0.88s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterWFSTTest
[junit4:junit4] Completed on J0 in 1.66s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSurroundQueryParser
[junit4:junit4] Completed on J1 in 0.75s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.DocumentAnalysisRequestHandlerTest
[junit4:junit4] Completed on J0 in 0.75s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.IndexSchemaRuntimeFieldTest
[junit4:junit4] Completed on J1 in 1.00s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.SolrPluginUtilsTest
[junit4:junit4] Completed on J0 in 0.93s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestValueSourceCache
[junit4:junit4] Completed on J1 in 0.88s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.highlight.FastVectorHighlighterTest
[junit4:junit4] Completed on J0 in 0.99s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestReversedWildcardFilterFactory
[junit4:junit4] Completed on J1 in 0.66s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.JSONWriterTest
[junit4:junit4] Completed on J0 in 0.78s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.RequestHandlersTest
[junit4:junit4] Completed on J1 in 0.83s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.SearchHandlerTest
[junit4:junit4] Completed on J0 in 0.73s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.CopyFieldTest
[junit4:junit4] Completed on J0 in 0.82s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterFSTTest
[junit4:junit4] Completed on J1 in 1.39s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.admin.LoggingHandlerTest
[junit4:junit4] Completed on J1 in 1.00s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestQueryUtils
[junit4:junit4] Completed on J0 in 1.21s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterTSTTest
[junit4:junit4] Completed on J1 in 1.70s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.SolrCmdDistributorTest
[junit4:junit4] Completed on J0 in 2.20s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.processor.UniqFieldsUpdateProcessorFactoryTest
[junit4:junit4] Completed on J1 in 0.96s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.NotRequiredUniqueKeyTest
[junit4:junit4] Completed on J1 in 0.27s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.CSVRequestHandlerTest
[junit4:junit4] Completed on J0 in 0.89s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestFoldingMultitermQuery
[junit4:junit4] Completed on J0 in 1.58s, 18 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.BadIndexSchemaTest
[junit4:junit4] Completed on J1 in 2.10s, 9 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestSolrDeletionPolicy1
[junit4:junit4] Completed on J0 in 1.35s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.servlet.NoCacheHeaderTest
[junit4:junit4] Completed on J1 in 0.92s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.BadComponentTest
[junit4:junit4] Completed on J1 in 0.72s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.CSVPrinterTest
[junit4:junit4] Completed on J1 in 0.73s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.PrimitiveFieldTypeTest
[junit4:junit4] Completed on J0 in 1.51s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestPropInjectDefaults
[junit4:junit4] Completed on J1 in 0.90s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.processor.DefaultValueUpdateProcessorTest
[junit4:junit4] Completed on J0 in 1.03s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestLFUCache
[junit4:junit4] Completed on J1 in 0.74s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestQuerySenderListener
[junit4:junit4] Completed on J0 in 0.72s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.NumericFieldsTest
[junit4:junit4] Completed on J0 in 0.47s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.IndexReaderFactoryTest
[junit4:junit4] Completed on J1 in 0.65s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapaneseKatakanaStemFilterFactory
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapaneseBaseFormFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.MultiTermTest
[junit4:junit4] Completed on J1 in 0.36s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestConfig
[junit4:junit4] Completed on J0 in 0.40s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapaneseTokenizerFactory
[junit4:junit4] Completed on J1 in 0.06s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestKStemFilterFactory
[junit4:junit4] Completed on J0 in 0.17s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.SpellPossibilityIteratorTest
[junit4:junit4] Completed on J1 in 0.31s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.TestPhraseSuggestions
[junit4:junit4] Completed on J0 in 0.23s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestPluginEnable
[junit4:junit4] Completed on J0 in 0.28s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestPerFieldSimilarity
[junit4:junit4] Completed on J1 in 0.54s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.LegacyHTMLStripCharFilterTest
[junit4:junit4] IGNORED 0.00s J0 | LegacyHTMLStripCharFilterTest.testRandom
[junit4:junit4]    > Cause: Annotated @Ignore(broken offsets: see LUCENE-2208)
[junit4:junit4] Completed on J0 in 0.26s, 13 tests, 1 skipped
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestLMJelinekMercerSimilarityFactory
[junit4:junit4] Completed on J1 in 0.21s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestHyphenationCompoundWordTokenFilterFactory
[junit4:junit4] Completed on J0 in 0.21s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestCodecSupport
[junit4:junit4] Completed on J1 in 0.22s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestDefaultSimilarityFactory
[junit4:junit4] Completed on J0 in 0.23s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.PrimUtilsTest
[junit4:junit4] Completed on J0 in 0.04s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.OpenExchangeRatesOrgProviderTest
[junit4:junit4] Completed on J0 in 0.05s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.processor.URLClassifyProcessorTest
[junit4:junit4] Completed on J1 in 0.60s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestUAX29URLEmailTokenizerFactory
[junit4:junit4] Completed on J0 in 0.06s, 8 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestGalicianStemFilterFactory
[junit4:junit4] Completed on J1 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestCapitalizationFilterFactory
[junit4:junit4] Completed on J0 in 0.04s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestCzechStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.ResourceLoaderTest
[junit4:junit4] Completed on J0 in 0.04s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.FileUtilsTest
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestSolrXMLSerializer
[junit4:junit4] Completed on J0 in 0.03s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.DateFieldTest
[junit4:junit4] IGNORED 0.00s J1 | DateFieldTest.testRoundTripNonPositiveYear
[junit4:junit4]    > Cause: Annotated @Ignore(SOLR-2773: Non-Positive years don't work)
[junit4:junit4] Completed on J1 in 0.04s, 8 tests, 1 skipped
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.SpellingQueryConverterTest
[junit4:junit4] Completed on J0 in 0.03s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestGermanLightStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.ExtendedBufferedReaderTest
[junit4:junit4] Completed on J1 in 0.04s, 8 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestStopFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestElisionFilterFactory
[junit4:junit4] Completed on J1 in 0.04s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestReverseStringFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestBrazilianStemFilterFactory
[junit4:junit4] Completed on J1 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestSpanishLightStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4] Completed on J1 in 0.02s, 0 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestBadConfig
[junit4:junit4] Completed on J0 in 2.07s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestIrishLowerCaseFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.UUIDFieldTest
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestGreekStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.TestUtils
[junit4:junit4] Completed on J0 in 0.02s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.SnowballPorterFilterFactoryTest
[junit4:junit4] Completed on J1 in 0.02s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestEnglishMinimalStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestHunspellStemFilterFactory
[junit4:junit4] Completed on J1 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestItalianLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPorterStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestArabicFilters
[junit4:junit4] Completed on J0 in 0.02s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestCJKBigramFilterFactory
[junit4:junit4] Completed on J1 in 0.02s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestDictionaryCompoundWordTokenFilterFactory
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.PreAnalyzedFieldTest
[junit4:junit4] Completed on J1 in 0.02s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPortugueseLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.CSVUtilsTest
[junit4:junit4] Completed on J1 in 0.07s, 14 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestNorwegianMinimalStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestStemmerOverrideFilterFactory
[junit4:junit4] Completed on J1 in 0.02s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.writer.CSVWriterTest
[junit4:junit4] Completed on J0 in 0.01s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.CircularListTest
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.writer.CSVConfigTest
[junit4:junit4] Completed on J0 in 0.01s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestLatvianStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestRussianLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestDocumentBuilder
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestCharFilters
[junit4:junit4] Completed on J0 in 0.34s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapaneseIterationMarkCharFilterFactory
[junit4:junit4] Completed on J0 in 0.04s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestRTGBase
[junit4:junit4] Completed on J0 in 0.00s, 0 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSolrJ
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.AnalysisAfterCoreReloadTest
[junit4:junit4] Completed on J1 in 3.58s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestStressVersions
[junit4:junit4] Completed on J1 in 13.16s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.processor.ScriptEngineTest
[junit4:junit4] Completed on J1 in 0.19s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestStressReorder
[junit4:junit4] Completed on J0 in 14.16s, 1 test
[junit4:junit4]  
[junit4:junit4] JVM J0:     0.86 ..   879.86 =   879.00s
[junit4:junit4] JVM J1:     0.86 ..   876.81 =   875.95s
[junit4:junit4] Execution time total: 14 minutes 39 seconds
[junit4:junit4] Tests summary: 297 suites, 1054 tests, 2 suite-level errors, 1 failure, 5 ignored

BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/build.xml:29: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build.xml:144: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/module-build.xml:62: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:1094: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:789: There were test failures: 297 suites, 1054 tests, 2 suite-level errors, 1 failure, 5 ignored

Total time: 27 minutes 19 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-tests-only-trunk-java7 - Build # 2953 - Still Failing

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk-java7/2953/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.FullSolrCloudTest.testDistribSearch

Error Message:
Timeout occured while waiting response from server at: http://localhost:32077/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://localhost:32077/solr/collection1
        at __randomizedtesting.SeedInfo.seed([57B5E9D45FE12268:D65367CC28BE4254]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:410)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
        at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
        at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:324)
        at org.apache.solr.cloud.FullSolrCloudTest.testUpdateAndDelete(FullSolrCloudTest.java:629)
        at org.apache.solr.cloud.FullSolrCloudTest.doTest(FullSolrCloudTest.java:567)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:679)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:671)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:697)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:736)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:747)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:150)
        at java.net.SocketInputStream.read(SocketInputStream.java:121)
        at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:149)
        at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:111)
        at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:264)
        at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:98)
        at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252)
        at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282)
        at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247)
        at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216)
        at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298)
        at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
        at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647)
        at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
        ... 45 more




Build Log:
[...truncated 14431 lines...]
[junit4:junit4]   2> at org.eclipse.jetty.server.Server.handle(Server.java:351)
[junit4:junit4]   2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
[junit4:junit4]   2> at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
[junit4:junit4]   2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:890)
[junit4:junit4]   2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:944)
[junit4:junit4]   2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:634)
[junit4:junit4]   2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:230)
[junit4:junit4]   2> at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
[junit4:junit4]   2> at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
[junit4:junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
[junit4:junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 94685 T2464 C141 P32077 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@16d29890
[junit4:junit4]   2> 94686 T2464 C141 P32077 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 94689 T2464 C141 P32077 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=12,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=152,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 94728 T2432 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 13960
[junit4:junit4]   2> 94728 T2432 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=952119285
[junit4:junit4]   2> 94728 T2432 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:13960_solr_collection1
[junit4:junit4]   2> 94729 T2432 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@36d1a07c
[junit4:junit4]   2> 94731 T2432 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 94731 T2432 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 94734 T2432 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:13960_solr_collection1
[junit4:junit4]   2> 94835 T2959 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 94835 T2432 oaz.ZooKeeper.close Session: 0x138b5288f6f000d closed
[junit4:junit4]   2> 94837 T2432 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 94890 T2432 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 11561
[junit4:junit4]   2> 94890 T2432 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1407756099
[junit4:junit4]   2> 94890 T2432 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:11561_solr_collection1
[junit4:junit4]   2> 94891 T2432 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@717a091e
[junit4:junit4]   2> 94892 T2432 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 94892 T2432 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=12,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=152,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 94895 T2432 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:11561_solr_collection1
[junit4:junit4]   2> 94997 T2490 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 94997 T2432 oaz.ZooKeeper.close Session: 0x138b5288f6f0005 closed
[junit4:junit4]   2> 94999 T2432 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 95051 T2432 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 57446
[junit4:junit4]   2> 95051 T2432 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1129455102
[junit4:junit4]   2> 95052 T2432 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:57446_solr_collection1
[junit4:junit4]   2> 95052 T2432 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7e46ee2c
[junit4:junit4]   2> 95054 T2432 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 95057 T2432 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=12,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=150,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 95059 T2432 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:57446_solr_collection1
[junit4:junit4]   2> 95161 T2503 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 95161 T2432 oaz.ZooKeeper.close Session: 0x138b5288f6f0006 closed
[junit4:junit4]   2> 95163 T2432 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 95215 T2432 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 40862
[junit4:junit4]   2> 95215 T2432 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1112820921
[junit4:junit4]   2> 95216 T2432 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:40862_solr_collection1
[junit4:junit4]   2> 95216 T2432 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4de8de3
[junit4:junit4]   2> 95219 T2432 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 95220 T2432 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 95226 T2432 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:40862_solr_collection1
[junit4:junit4]   2> 95328 T2982 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 95328 T2432 oaz.ZooKeeper.close Session: 0x138b5288f6f000e closed
[junit4:junit4]   2> 95330 T2432 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 95539 T2432 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   1>            "node_name":"127.0.0.1:32077_solr",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:32077/solr"}
[junit4:junit4]   1>      /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:57446_solr",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:57446/solr"}
[junit4:junit4]   1>    /solr/collections/control_collection (3)
[junit4:junit4]   1>    DATA:
[junit4:junit4]   1>        {"configName":"conf1"}
[junit4:junit4]   1>     /solr/collections/control_collection/shards (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leader_elect (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leader_elect/control_shard (1)
[junit4:junit4]   1>       /solr/collections/control_collection/leader_elect/control_shard/election (1)
[junit4:junit4]   1>        /solr/collections/control_collection/leader_elect/control_shard/election/88019378543460354-127.0.0.1:28842_solr_collection1-n_0000000000 (0)
[junit4:junit4]   1>     /solr/collections/control_collection/leaders (1)
[junit4:junit4]   1>      /solr/collections/control_collection/leaders/control_shard (0)
[junit4:junit4]   1>      DATA:
[junit4:junit4]   1>          {
[junit4:junit4]   1>            "core":"collection1",
[junit4:junit4]   1>            "node_name":"127.0.0.1:28842_solr",
[junit4:junit4]   1>            "base_url":"http://127.0.0.1:28842/solr"}
[junit4:junit4]   1>   /solr/clusterstate.json (0)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       {
[junit4:junit4]   1>         "collection1":{
[junit4:junit4]   1>           "shard1":{
[junit4:junit4]   1>             "127.0.0.1:32077_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:32077_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:32077/solr"},
[junit4:junit4]   1>             "127.0.0.1:11561_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:11561_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:11561/solr"},
[junit4:junit4]   1>             "127.0.0.1:40862_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard1",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:40862_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:40862/solr"}},
[junit4:junit4]   1>           "shard2":{
[junit4:junit4]   1>             "127.0.0.1:13960_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard2",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:13960_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:13960/solr"},
[junit4:junit4]   1>             "127.0.0.1:57446_solr_collection1":{
[junit4:junit4]   1>               "shard":"shard2",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"collection1",
[junit4:junit4]   1>               "node_name":"127.0.0.1:57446_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:57446/solr"}}},
[junit4:junit4]   1>         "control_collection":{"control_shard":{"127.0.0.1:28842_solr_collection1":{
[junit4:junit4]   1>               "shard":"control_shard",
[junit4:junit4]   1>               "roles":null,
[junit4:junit4]   1>               "leader":"true",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "core":"collection1",
[junit4:junit4]   1>               "collection":"control_collection",
[junit4:junit4]   1>               "node_name":"127.0.0.1:28842_solr",
[junit4:junit4]   1>               "base_url":"http://127.0.0.1:28842/solr"}}}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1>
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudTest -Dtests.method=testDistribSearch -Dtests.seed=57B5E9D45FE12268 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_YE -Dtests.timezone=America/Argentina/Ushuaia -Dtests.file.encoding=UTF-8
[junit4:junit4]   1>
[junit4:junit4]   2>
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 95602 T2432 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {n_f1=Lucene40(minBlockSize=79 maxBlockSize=254), foo_b=MockVariableIntBlock(baseBlockSize=51), foo_d=Pulsing40(freqCutoff=4 minBlockSize=79 maxBlockSize=254), foo_f=MockVariableIntBlock(baseBlockSize=51), n_tl1=Lucene40(minBlockSize=79 maxBlockSize=254), n_d1=MockFixedIntBlock(blockSize=1554), rnd_b=Pulsing40(freqCutoff=4 minBlockSize=79 maxBlockSize=254), intDefault=MockFixedIntBlock(blockSize=1554), n_td1=Lucene40(minBlockSize=79 maxBlockSize=254), id=Pulsing40(freqCutoff=4 minBlockSize=79 maxBlockSize=254), timestamp=MockFixedIntBlock(blockSize=1554), range_facet_sl=MockVariableIntBlock(baseBlockSize=51), range_facet_si=Lucene40(minBlockSize=79 maxBlockSize=254), oddField_s=MockVariableIntBlock(baseBlockSize=51), multiDefault=Lucene40(minBlockSize=79 maxBlockSize=254), n_tf1=MockFixedIntBlock(blockSize=1554), n_dt1=Lucene40(minBlockSize=79 maxBlockSize=254), n_ti1=Pulsing40(freqCutoff=4 minBlockSize=79 maxBlockSize=254), range_facet_l=MockFixedIntBlock(blockSize=1554), text=MockVariableIntBlock(baseBlockSize=51), _version_=MockFixedIntBlock(blockSize=1554), SubjectTerms_mfacet=MockFixedIntBlock(blockSize=1554), a_t=MockFixedIntBlock(blockSize=1554), n_tdt1=MockFixedIntBlock(blockSize=1554), other_tl1=MockFixedIntBlock(blockSize=1554), n_l1=MockFixedIntBlock(blockSize=1554), a_si=Lucene40(minBlockSize=79 maxBlockSize=254)}, sim=DefaultSimilarity, locale=ar_YE, timezone=America/Argentina/Ushuaia
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=1,free=215580848,total=383778816
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestWikipediaTokenizerFactory, DebugComponentTest, TestReload, TestPersianNormalizationFilterFactory, ResourceLoaderTest, TestLRUCache, TestReverseStringFilterFactory, CSVRequestHandlerTest, TestPropInjectDefaults, SampleTest, TestConfig, TimeZoneUtilsTest, IndexSchemaRuntimeFieldTest, TestBinaryResponseWriter, TestDocSet, TestCJKBigramFilterFactory, TestStressReorder, BasicZkTest, CircularListTest, MultiTermTest, TestShingleFilterFactory, TestUAX29URLEmailTokenizerFactory, TestGreekStemFilterFactory, TestDocumentBuilder, DocumentBuilderTest, IndexSchemaTest, IndexReaderFactoryTest, URLClassifyProcessorTest, TestTrie, TestHungarianLightStemFilterFactory, TestElisionFilterFactory, SignatureUpdateProcessorFactoryTest, MBeansHandlerTest, TestPortugueseLightStemFilterFactory, TestXIncludeConfig, UniqFieldsUpdateProcessorFactoryTest, PolyFieldTest, LeaderElectionTest, TestIndexSearcher, SolrCoreTest, SolrPluginUtilsTest, FieldMutatingUpdateProcessorTest, QueryParsingTest, OverseerTest, TestLMJelinekMercerSimilarityFactory, TestWriterPerf, TestJapaneseTokenizerFactory, TestGalicianMinimalStemFilterFactory, TestPatternReplaceFilterFactory, SearchHandlerTest, TestEnglishMinimalStemFilterFactory, PeerSyncTest, TestQuerySenderNoQuery, TestJapaneseIterationMarkCharFilterFactory, TestReplicationHandler, TestGermanMinimalStemFilterFactory, NoCacheHeaderTest, SpellCheckComponentTest, CommonGramsFilterFactoryTest, TestOmitPositions, JsonLoaderTest, TestFastLRUCache, TestIndonesianStemFilterFactory, SuggesterFSTTest, TestRussianLightStemFilterFactory, TestUtils, TestNGramFilters, TestLMDirichletSimilarityFactory, TestSystemIdResolver, BasicDistributedZkTest, FullSolrCloudTest]
[junit4:junit4]   2>
[junit4:junit4] Completed on J1 in 95.65s, 1 test, 1 error <<< FAILURES!
[...truncated 457 lines...]

[...truncated 15039 lines...]

[...truncated 15039 lines...]

[...truncated 15039 lines...]

[...truncated 15039 lines...]

[...truncated 15026 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/build.xml:29: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build.xml:144: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/module-build.xml:62: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:1094: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:789: There were test failures: 297 suites, 1054 tests, 1 error, 5 ignored

Total time: 30 minutes 57 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-tests-only-trunk-java7 - Build # 2954 - Still Failing

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk-java7/2954/

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest

Error Message:
ERROR: SolrIndexSearcher opens=54 closes=55

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=54 closes=55
        at __randomizedtesting.SeedInfo.seed([FED746F70B0DED22]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
        at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SyncSliceTest

Error Message:
ERROR: SolrIndexSearcher opens=24 closes=23

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=24 closes=23
        at __randomizedtesting.SeedInfo.seed([FED746F70B0DED22]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
        at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
        at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)




Build Log:
[...truncated 10121 lines...]
[junit4:junit4]   2>
[junit4:junit4]   2> 70808 T1638 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 70809 T1638 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 70809 T1638 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 70809 T1638 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 96501 T1625 oasc.SyncStrategy.syncToMe Could not tell a replica to recover org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:14485/solr/collection1
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncToMe(SyncStrategy.java:237)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.syncReplicas(SyncStrategy.java:119)
[junit4:junit4]   2> at org.apache.solr.cloud.SyncStrategy.sync(SyncStrategy.java:82)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:158)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to 127.0.0.1:14485 timed out
[junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:125)
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4]   2> ... 11 more
[junit4:junit4]   2>
[junit4:junit4]   2> 96502 T1625 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:14490_solr_collection1
[junit4:junit4]   2> 96502 T1625 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:244)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:241)
[junit4:junit4]   2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:236)
[junit4:junit4]   2> at org.apache.solr.cloud.ZkController.publish(ZkController.java:734)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:168)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:151)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:96)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 96503 T1625 oascc.ZkStateReader$3.process Updating live nodes
[junit4:junit4]   2> 96503 T1625 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 96503 T1625 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:266)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:263)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:91)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:57)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:125)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2>
[junit4:junit4]   2> 96504 T1625 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 96666 T1619 C114 P14490 oasc.SolrException.log SEVERE shard update error StdNode: http://127.0.0.1:14485/solr/collection1/:org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:14485/solr/collection1
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:407)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182)
[junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:336)
[junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$1.call(SolrCmdDistributor.java:317)
[junit4:junit4]   2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4:junit4]   2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> at org.apache.solr.update.SolrCmdDistributor$BoundedExecutor$1.run(SolrCmdDistributor.java:538)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connection to http://127.0.0.1:14485 refused
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:158)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
[junit4:junit4]   2> at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
[junit4:junit4]   2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
[junit4:junit4]   2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)
[junit4:junit4]   2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353)
[junit4:junit4]   2> ... 12 more
[junit4:junit4]   2> Caused by: java.net.ConnectException: Operation timed out
[junit4:junit4]   2> at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
[junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
[junit4:junit4]   2> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
[junit4:junit4]   2> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
[junit4:junit4]   2> at java.net.Socket.connect(Socket.java:579)
[junit4:junit4]   2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:123)
[junit4:junit4]   2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
[junit4:junit4]   2> ... 20 more
[junit4:junit4]   2>
[junit4:junit4]   2> 162171 T1579 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=24 closes=23
[junit4:junit4]   2> NOTE: test params are: codec=SimpleText, sim=DefaultSimilarity, locale=sl, timezone=America/Costa_Rica
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=6,free=101257640,total=434110464
[junit4:junit4]   2> NOTE: All tests run in this JVM: [CommonGramsQueryFilterFactoryTest, TestLatvianStemFilterFactory, DisMaxRequestHandlerTest, DOMUtilTest, PluginInfoTest, PrimitiveFieldTypeTest, TestDFRSimilarityFactory, TestFrenchLightStemFilterFactory, TestDistributedGrouping, SimpleFacetsTest, TestSearchPerf, TestSolrJ, HighlighterTest, TestCapitalizationFilterFactory, TestExtendedDismaxParser, FileUtilsTest, TestSwedishLightStemFilterFactory, TestSpanishLightStemFilterFactory, TestIndexingPerformance, TermsComponentTest, TestArabicFilters, ShowFileRequestHandlerTest, TestCharFilters, NumericFieldsTest, TestPhraseSuggestions, CurrencyFieldTest, CacheHeaderTest, DistributedSpellCheckComponentTest, IndexBasedSpellCheckerTest, DoubleMetaphoneFilterFactoryTest, SystemInfoHandlerTest, TestItalianLightStemFilterFactory, BasicFunctionalityTest, TestBadConfig, SnowballPorterFilterFactoryTest, SolrCmdDistributorTest, QueryElevationComponentTest, TestSynonymFilterFactory, TestJoin, LegacyHTMLStripCharFilterTest, TestBrazilianStemFilterFactory, JSONWriterTest, BasicDistributedZkTest, TestFinnishLightStemFilterFactory, OpenExchangeRatesOrgProviderTest, TestBulgarianStemFilterFactory, TestQuerySenderListener, TestReversedWildcardFilterFactory, UpdateRequestProcessorFactoryTest, TestStemmerOverrideFilterFactory, TestStandardFactories, TestUpdate, SuggesterTest, TestIrishLowerCaseFilterFactory, CoreAdminHandlerTest, TestPropInject, XmlUpdateRequestHandlerTest, DistributedQueryElevationComponentTest, CopyFieldTest, BinaryUpdateRequestHandlerTest, SyncSliceTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.seed=FED746F70B0DED22 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sl -Dtests.timezone=America/Costa_Rica -Dtests.file.encoding=ISO-8859-1
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | SyncSliceTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=24 closes=23
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([FED746F70B0DED22]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 162.25s, 1 test, 1 failure <<< FAILURES!
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.highlight.FastVectorHighlighterTest
[junit4:junit4] Completed on J0 in 1.06s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestHyphenationCompoundWordTokenFilterFactory
[junit4:junit4] Completed on J0 in 0.15s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.SolrInfoMBeanTest
[junit4:junit4] Completed on J0 in 1.03s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestNorwegianLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterWFSTTest
[junit4:junit4] Completed on J0 in 1.46s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestDistributedSearch
[junit4:junit4] Completed on J1 in 95.62s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.SpellCheckCollatorTest
[junit4:junit4] Completed on J1 in 2.25s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.SoftAutoCommitTest
[junit4:junit4] Completed on J1 in 10.50s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.AutoCommitTest
[junit4:junit4] Completed on J1 in 9.21s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.BasicZkTest
[junit4:junit4] Completed on J1 in 15.30s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPhoneticFilterFactory
[junit4:junit4] Completed on J1 in 10.24s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.TestFaceting
[junit4:junit4] Completed on J1 in 10.61s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.WordBreakSolrSpellCheckerTest
[junit4:junit4] Completed on J1 in 1.47s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.TestHashPartitioner
[junit4:junit4] Completed on J1 in 7.79s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.DistributedTermsComponentTest
[junit4:junit4] Completed on J1 in 7.21s, 1 test
[junit4:junit4]  
[junit4:junit4] HEARTBEAT J0: 2012-07-23T20:57:55, no events in: 65.8s, approx. at: FullSolrCloudDistribCmdsTest.testDistribSearch
[junit4:junit4] Suite: org.apache.solr.handler.component.StatsComponentTest
[junit4:junit4] Completed on J1 in 6.02s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.SolrCoreTest
[junit4:junit4] Completed on J1 in 6.50s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestRangeQuery
[junit4:junit4] Completed on J1 in 6.87s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.TestMultiCoreConfBootstrap
[junit4:junit4] Completed on J1 in 2.42s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.admin.LukeRequestHandlerTest
[junit4:junit4] Completed on J1 in 2.38s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSort
[junit4:junit4] Completed on J1 in 4.53s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 51484 T1684 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 51500 T1826 oasc.Overseer$CloudStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:289)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:286)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:286)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.amILeader(Overseer.java:187)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 51500 T1826 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88019891545243652-127.0.0.1:50204_solr-n_0000000002) am no longer a leader.
[junit4:junit4]   2> 51548 T1828 oasc.Overseer$CloudStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:289)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:286)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:286)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.amILeader(Overseer.java:187)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 51548 T1828 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88019891545243654-127.0.0.1:36563_solr-n_0000000004) am no longer a leader.
[junit4:junit4]   2> 52617 T1687 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 172605 T1684 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=54 closes=55
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {range_facet_l=MockFixedIntBlock(blockSize=178), n_ti1=PostingsFormat(name=Memory doPackFST= false), n_f1=MockFixedIntBlock(blockSize=178), text=PostingsFormat(name=Asserting), _version_=MockFixedIntBlock(blockSize=178), n_tl1=MockFixedIntBlock(blockSize=178), n_d1=PostingsFormat(name=SimpleText), rnd_b=PostingsFormat(name=Memory doPackFST= false), intDefault=MockFixedIntBlock(blockSize=178), n_td1=MockFixedIntBlock(blockSize=178), timestamp=MockFixedIntBlock(blockSize=178), id=PostingsFormat(name=Memory doPackFST= false), range_facet_sl=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=SimpleText), n_tdt1=MockFixedIntBlock(blockSize=178), range_facet_si=PostingsFormat(name=SimpleText), n_l1=PostingsFormat(name=SimpleText), multiDefault=MockFixedIntBlock(blockSize=178), n_tf1=PostingsFormat(name=SimpleText), n_dt1=MockFixedIntBlock(blockSize=178)}, sim=RandomSimilarityProvider(queryNorm=true,coord=true): {}, locale=pl, timezone=Pacific/Guam
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=5,free=178645896,total=434110464
[junit4:junit4]   2> NOTE: All tests run in this JVM: [CommonGramsQueryFilterFactoryTest, TestLatvianStemFilterFactory, DisMaxRequestHandlerTest, DOMUtilTest, PluginInfoTest, PrimitiveFieldTypeTest, TestDFRSimilarityFactory, TestFrenchLightStemFilterFactory, TestDistributedGrouping, SimpleFacetsTest, TestSearchPerf, TestSolrJ, HighlighterTest, TestCapitalizationFilterFactory, TestExtendedDismaxParser, FileUtilsTest, TestSwedishLightStemFilterFactory, TestSpanishLightStemFilterFactory, TestIndexingPerformance, TermsComponentTest, TestArabicFilters, ShowFileRequestHandlerTest, TestCharFilters, NumericFieldsTest, TestPhraseSuggestions, CurrencyFieldTest, CacheHeaderTest, DistributedSpellCheckComponentTest, IndexBasedSpellCheckerTest, DoubleMetaphoneFilterFactoryTest, SystemInfoHandlerTest, TestItalianLightStemFilterFactory, BasicFunctionalityTest, TestBadConfig, SnowballPorterFilterFactoryTest, SolrCmdDistributorTest, QueryElevationComponentTest, TestSynonymFilterFactory, TestJoin, LegacyHTMLStripCharFilterTest, TestBrazilianStemFilterFactory, JSONWriterTest, BasicDistributedZkTest, TestFinnishLightStemFilterFactory, OpenExchangeRatesOrgProviderTest, TestBulgarianStemFilterFactory, TestQuerySenderListener, TestReversedWildcardFilterFactory, UpdateRequestProcessorFactoryTest, TestStemmerOverrideFilterFactory, TestStandardFactories, TestUpdate, SuggesterTest, TestIrishLowerCaseFilterFactory, CoreAdminHandlerTest, TestPropInject, XmlUpdateRequestHandlerTest, DistributedQueryElevationComponentTest, CopyFieldTest, BinaryUpdateRequestHandlerTest, SyncSliceTest, FastVectorHighlighterTest, TestHyphenationCompoundWordTokenFilterFactory, SolrInfoMBeanTest, TestNorwegianLightStemFilterFactory, SuggesterWFSTTest, FullSolrCloudDistribCmdsTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudDistribCmdsTest -Dtests.seed=FED746F70B0DED22 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pl -Dtests.timezone=Pacific/Guam -Dtests.file.encoding=ISO-8859-1
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | FullSolrCloudDistribCmdsTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=54 closes=55
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([FED746F70B0DED22]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 172.62s, 1 test, 1 failure <<< FAILURES!
[...truncated 413 lines...]

[...truncated 10815 lines...]

[...truncated 10815 lines...]

[...truncated 10815 lines...]

[...truncated 10815 lines...]

[...truncated 10237 lines...]
[junit4:junit4]   2> 162171 T1579 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=24 closes=23
[junit4:junit4]   2> NOTE: test params are: codec=SimpleText, sim=DefaultSimilarity, locale=sl, timezone=America/Costa_Rica
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=6,free=101257640,total=434110464
[junit4:junit4]   2> NOTE: All tests run in this JVM: [CommonGramsQueryFilterFactoryTest, TestLatvianStemFilterFactory, DisMaxRequestHandlerTest, DOMUtilTest, PluginInfoTest, PrimitiveFieldTypeTest, TestDFRSimilarityFactory, TestFrenchLightStemFilterFactory, TestDistributedGrouping, SimpleFacetsTest, TestSearchPerf, TestSolrJ, HighlighterTest, TestCapitalizationFilterFactory, TestExtendedDismaxParser, FileUtilsTest, TestSwedishLightStemFilterFactory, TestSpanishLightStemFilterFactory, TestIndexingPerformance, TermsComponentTest, TestArabicFilters, ShowFileRequestHandlerTest, TestCharFilters, NumericFieldsTest, TestPhraseSuggestions, CurrencyFieldTest, CacheHeaderTest, DistributedSpellCheckComponentTest, IndexBasedSpellCheckerTest, DoubleMetaphoneFilterFactoryTest, SystemInfoHandlerTest, TestItalianLightStemFilterFactory, BasicFunctionalityTest, TestBadConfig, SnowballPorterFilterFactoryTest, SolrCmdDistributorTest, QueryElevationComponentTest, TestSynonymFilterFactory, TestJoin, LegacyHTMLStripCharFilterTest, TestBrazilianStemFilterFactory, JSONWriterTest, BasicDistributedZkTest, TestFinnishLightStemFilterFactory, OpenExchangeRatesOrgProviderTest, TestBulgarianStemFilterFactory, TestQuerySenderListener, TestReversedWildcardFilterFactory, UpdateRequestProcessorFactoryTest, TestStemmerOverrideFilterFactory, TestStandardFactories, TestUpdate, SuggesterTest, TestIrishLowerCaseFilterFactory, CoreAdminHandlerTest, TestPropInject, XmlUpdateRequestHandlerTest, DistributedQueryElevationComponentTest, CopyFieldTest, BinaryUpdateRequestHandlerTest, SyncSliceTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.seed=FED746F70B0DED22 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sl -Dtests.timezone=America/Costa_Rica -Dtests.file.encoding=ISO-8859-1
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | SyncSliceTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=24 closes=23
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([FED746F70B0DED22]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 162.25s, 1 test, 1 failure <<< FAILURES!
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.highlight.FastVectorHighlighterTest
[junit4:junit4] Completed on J0 in 1.06s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestHyphenationCompoundWordTokenFilterFactory
[junit4:junit4] Completed on J0 in 0.15s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.SolrInfoMBeanTest
[junit4:junit4] Completed on J0 in 1.03s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestNorwegianLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterWFSTTest
[junit4:junit4] Completed on J0 in 1.46s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestDistributedSearch
[junit4:junit4] Completed on J1 in 95.62s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.SpellCheckCollatorTest
[junit4:junit4] Completed on J1 in 2.25s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.SoftAutoCommitTest
[junit4:junit4] Completed on J1 in 10.50s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.AutoCommitTest
[junit4:junit4] Completed on J1 in 9.21s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.BasicZkTest
[junit4:junit4] Completed on J1 in 15.30s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPhoneticFilterFactory
[junit4:junit4] Completed on J1 in 10.24s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.TestFaceting
[junit4:junit4] Completed on J1 in 10.61s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.WordBreakSolrSpellCheckerTest
[junit4:junit4] Completed on J1 in 1.47s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.TestHashPartitioner
[junit4:junit4] Completed on J1 in 7.79s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.DistributedTermsComponentTest
[junit4:junit4] Completed on J1 in 7.21s, 1 test
[junit4:junit4]  
[junit4:junit4] HEARTBEAT J0: 2012-07-23T20:57:55, no events in: 65.8s, approx. at: FullSolrCloudDistribCmdsTest.testDistribSearch
[junit4:junit4] Suite: org.apache.solr.handler.component.StatsComponentTest
[junit4:junit4] Completed on J1 in 6.02s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.SolrCoreTest
[junit4:junit4] Completed on J1 in 6.50s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestRangeQuery
[junit4:junit4] Completed on J1 in 6.87s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.TestMultiCoreConfBootstrap
[junit4:junit4] Completed on J1 in 2.42s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.admin.LukeRequestHandlerTest
[junit4:junit4] Completed on J1 in 2.38s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSort
[junit4:junit4] Completed on J1 in 4.53s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4:junit4]    > (@AfterClass output)
[junit4:junit4]   2> 51484 T1684 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 51500 T1826 oasc.Overseer$CloudStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:289)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:286)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:286)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.amILeader(Overseer.java:187)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 51500 T1826 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88019891545243652-127.0.0.1:50204_solr-n_0000000002) am no longer a leader.
[junit4:junit4]   2> 51548 T1828 oasc.Overseer$CloudStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:289)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:286)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:67)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:286)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.amILeader(Overseer.java:187)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:113)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>
[junit4:junit4]   2> 51548 T1828 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=88019891545243654-127.0.0.1:36563_solr-n_0000000004) am no longer a leader.
[junit4:junit4]   2> 52617 T1687 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 172605 T1684 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=54 closes=55
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40: {range_facet_l=MockFixedIntBlock(blockSize=178), n_ti1=PostingsFormat(name=Memory doPackFST= false), n_f1=MockFixedIntBlock(blockSize=178), text=PostingsFormat(name=Asserting), _version_=MockFixedIntBlock(blockSize=178), n_tl1=MockFixedIntBlock(blockSize=178), n_d1=PostingsFormat(name=SimpleText), rnd_b=PostingsFormat(name=Memory doPackFST= false), intDefault=MockFixedIntBlock(blockSize=178), n_td1=MockFixedIntBlock(blockSize=178), timestamp=MockFixedIntBlock(blockSize=178), id=PostingsFormat(name=Memory doPackFST= false), range_facet_sl=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=SimpleText), n_tdt1=MockFixedIntBlock(blockSize=178), range_facet_si=PostingsFormat(name=SimpleText), n_l1=PostingsFormat(name=SimpleText), multiDefault=MockFixedIntBlock(blockSize=178), n_tf1=PostingsFormat(name=SimpleText), n_dt1=MockFixedIntBlock(blockSize=178)}, sim=RandomSimilarityProvider(queryNorm=true,coord=true): {}, locale=pl, timezone=Pacific/Guam
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_04 (64-bit)/cpus=16,threads=5,free=178645896,total=434110464
[junit4:junit4]   2> NOTE: All tests run in this JVM: [CommonGramsQueryFilterFactoryTest, TestLatvianStemFilterFactory, DisMaxRequestHandlerTest, DOMUtilTest, PluginInfoTest, PrimitiveFieldTypeTest, TestDFRSimilarityFactory, TestFrenchLightStemFilterFactory, TestDistributedGrouping, SimpleFacetsTest, TestSearchPerf, TestSolrJ, HighlighterTest, TestCapitalizationFilterFactory, TestExtendedDismaxParser, FileUtilsTest, TestSwedishLightStemFilterFactory, TestSpanishLightStemFilterFactory, TestIndexingPerformance, TermsComponentTest, TestArabicFilters, ShowFileRequestHandlerTest, TestCharFilters, NumericFieldsTest, TestPhraseSuggestions, CurrencyFieldTest, CacheHeaderTest, DistributedSpellCheckComponentTest, IndexBasedSpellCheckerTest, DoubleMetaphoneFilterFactoryTest, SystemInfoHandlerTest, TestItalianLightStemFilterFactory, BasicFunctionalityTest, TestBadConfig, SnowballPorterFilterFactoryTest, SolrCmdDistributorTest, QueryElevationComponentTest, TestSynonymFilterFactory, TestJoin, LegacyHTMLStripCharFilterTest, TestBrazilianStemFilterFactory, JSONWriterTest, BasicDistributedZkTest, TestFinnishLightStemFilterFactory, OpenExchangeRatesOrgProviderTest, TestBulgarianStemFilterFactory, TestQuerySenderListener, TestReversedWildcardFilterFactory, UpdateRequestProcessorFactoryTest, TestStemmerOverrideFilterFactory, TestStandardFactories, TestUpdate, SuggesterTest, TestIrishLowerCaseFilterFactory, CoreAdminHandlerTest, TestPropInject, XmlUpdateRequestHandlerTest, DistributedQueryElevationComponentTest, CopyFieldTest, BinaryUpdateRequestHandlerTest, SyncSliceTest, FastVectorHighlighterTest, TestHyphenationCompoundWordTokenFilterFactory, SolrInfoMBeanTest, TestNorwegianLightStemFilterFactory, SuggesterWFSTTest, FullSolrCloudDistribCmdsTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudDistribCmdsTest -Dtests.seed=FED746F70B0DED22 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pl -Dtests.timezone=Pacific/Guam -Dtests.file.encoding=ISO-8859-1
[junit4:junit4]   2>
[junit4:junit4] ERROR   0.00s J0 | FullSolrCloudDistribCmdsTest (suite)
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=54 closes=55
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([FED746F70B0DED22]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:216)
[junit4:junit4]    > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:82)
[junit4:junit4]    > at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:754)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551)
[junit4:junit4]    >
[junit4:junit4] Completed on J0 in 172.62s, 1 test, 1 failure <<< FAILURES!
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestThaiWordFilterFactory
[junit4:junit4] Completed on J0 in 0.05s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.PingRequestHandlerTest
[junit4:junit4] Completed on J0 in 0.80s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.function.TestFunctionQuery
[junit4:junit4] Completed on J0 in 2.55s, 14 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.DirectUpdateHandlerTest
[junit4:junit4] Completed on J0 in 2.78s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.response.TestPHPSerializedResponseWriter
[junit4:junit4] Completed on J0 in 1.02s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestGreekLowerCaseFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.DirectSolrSpellCheckerTest
[junit4:junit4] Completed on J0 in 1.31s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestGroupingSearch
[junit4:junit4] Completed on J1 in 22.95s, 12 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.FileBasedSpellCheckerTest
[junit4:junit4] Completed on J1 in 0.92s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.ConvertedLegacyTest
[junit4:junit4] Completed on J1 in 2.80s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.PeerSyncTest
[junit4:junit4] Completed on J1 in 3.55s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.function.SortByFunctionTest
[junit4:junit4] Completed on J1 in 2.20s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.TestBinaryResponseWriter
[junit4:junit4] Completed on J1 in 1.26s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestJmxIntegration
[junit4:junit4] IGNORED 0.00s J1 | TestJmxIntegration.testJmxOnCoreReload
[junit4:junit4]    > Cause: Annotated @Ignore(timing problem? https://issues.apache.org/jira/browse/SOLR-2715)
[junit4:junit4] Completed on J1 in 1.80s, 3 tests, 1 skipped
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestIndexSearcher
[junit4:junit4] Completed on J1 in 1.76s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.servlet.SolrRequestParserTest
[junit4:junit4] Completed on J1 in 1.37s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.TestRemoteStreaming
[junit4:junit4] Completed on J1 in 1.23s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.QueryEqualityTest
[junit4:junit4] Completed on J1 in 1.02s, 58 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestWordDelimiterFilterFactory
[junit4:junit4] Completed on J1 in 1.14s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.TestCSVLoader
[junit4:junit4] Completed on J1 in 1.54s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.SpatialFilterTest
[junit4:junit4] Completed on J1 in 1.59s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.MoreLikeThisHandlerTest
[junit4:junit4] Completed on J1 in 1.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.DocumentBuilderTest
[junit4:junit4] Completed on J1 in 0.82s, 11 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.IndexSchemaTest
[junit4:junit4] Completed on J1 in 0.77s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.function.distance.DistanceFunctionTest
[junit4:junit4] Completed on J1 in 0.84s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.XsltUpdateRequestHandlerTest
[junit4:junit4] Completed on J1 in 1.26s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.MinimalSchemaTest
[junit4:junit4] Completed on J1 in 0.84s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestFiltering
[junit4:junit4] Completed on J0 in 22.56s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.TermVectorComponentTest
[junit4:junit4] Completed on J1 in 1.28s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSurroundQueryParser
[junit4:junit4] Completed on J1 in 0.82s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.JsonLoaderTest
[junit4:junit4] Completed on J0 in 0.93s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.DocumentAnalysisRequestHandlerTest
[junit4:junit4] Completed on J1 in 0.84s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.DirectUpdateHandlerOptimizeTest
[junit4:junit4] Completed on J0 in 1.00s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestSolrQueryParser
[junit4:junit4] Completed on J1 in 0.87s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.SolrPluginUtilsTest
[junit4:junit4] Completed on J0 in 0.86s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestValueSourceCache
[junit4:junit4] Completed on J1 in 0.77s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.ReturnFieldsTest
[junit4:junit4] Completed on J1 in 1.09s, 10 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.DebugComponentTest
[junit4:junit4] Completed on J0 in 1.21s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.SearchHandlerTest
[junit4:junit4] Completed on J0 in 0.87s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.RequestHandlersTest
[junit4:junit4] Completed on J1 in 1.02s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.RequiredFieldsTest
[junit4:junit4] Completed on J0 in 0.69s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestArbitraryIndexDir
[junit4:junit4] Completed on J1 in 0.79s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestQueryUtils
[junit4:junit4] Completed on J0 in 1.16s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.suggest.SuggesterTSTTest
[junit4:junit4] Completed on J1 in 1.24s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.UpdateParamsTest
[junit4:junit4] Completed on J0 in 1.26s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.BadIndexSchemaTest
[junit4:junit4] Completed on J1 in 2.08s, 9 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestFoldingMultitermQuery
[junit4:junit4] Completed on J0 in 1.40s, 18 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.request.TestWriterPerf
[junit4:junit4] Completed on J0 in 1.50s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.SolrCoreCheckLockOnStartupTest
[junit4:junit4] Completed on J1 in 1.60s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.handler.component.BadComponentTest
[junit4:junit4] Completed on J1 in 0.91s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.servlet.NoCacheHeaderTest
[junit4:junit4] Completed on J0 in 1.18s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.TestBinaryField
[junit4:junit4] Completed on J0 in 0.38s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.CSVPrinterTest
[junit4:junit4] Completed on J1 in 0.73s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestSolrDeletionPolicy2
[junit4:junit4] Completed on J0 in 0.99s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.SOLR749Test
[junit4:junit4] Completed on J1 in 0.95s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestMergePolicyConfig
[junit4:junit4] Completed on J1 in 0.87s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.processor.DefaultValueUpdateProcessorTest
[junit4:junit4] Completed on J0 in 0.92s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.SolrIndexConfigTest
[junit4:junit4] Completed on J0 in 0.95s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestLFUCache
[junit4:junit4] Completed on J1 in 0.90s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.OutputWriterTest
[junit4:junit4] Completed on J1 in 0.25s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestBeiderMorseFilterFactory
[junit4:junit4] Completed on J1 in 0.38s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.IndexReaderFactoryTest
[junit4:junit4] Completed on J0 in 0.84s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapaneseKatakanaStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestSolrCoreProperties
[junit4:junit4] Completed on J0 in 0.23s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapaneseBaseFormFilterFactory
[junit4:junit4] Completed on J1 in 0.08s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestKStemFilterFactory
[junit4:junit4] Completed on J1 in 0.13s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.EchoParamsTest
[junit4:junit4] Completed on J0 in 0.14s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestBM25SimilarityFactory
[junit4:junit4] Completed on J0 in 0.18s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.SpellPossibilityIteratorTest
[junit4:junit4] Completed on J1 in 0.31s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestPerFieldSimilarity
[junit4:junit4] Completed on J0 in 0.28s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.TestPluginEnable
[junit4:junit4] Completed on J1 in 0.14s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestIBSimilarityFactory
[junit4:junit4] Completed on J0 in 0.14s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestCodecSupport
[junit4:junit4] Completed on J1 in 0.21s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.similarities.TestDefaultSimilarityFactory
[junit4:junit4] Completed on J0 in 0.19s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestHTMLStripCharFilterFactory
[junit4:junit4] Completed on J1 in 0.04s, 6 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestFastLRUCache
[junit4:junit4] Completed on J0 in 0.05s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.DateMathParserTest
[junit4:junit4] Completed on J1 in 0.06s, 8 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestShingleFilterFactory
[junit4:junit4] Completed on J0 in 0.08s, 13 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestMultiWordSynonyms
[junit4:junit4] Completed on J1 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestGalicianStemFilterFactory
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.ResourceLoaderTest
[junit4:junit4] Completed on J1 in 0.04s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPortugueseMinimalStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.core.TestSolrXMLSerializer
[junit4:junit4] Completed on J1 in 0.03s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestDelimitedPayloadTokenFilterFactory
[junit4:junit4] Completed on J0 in 0.02s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.DateFieldTest
[junit4:junit4] IGNORED 0.00s J1 | DateFieldTest.testRoundTripNonPositiveYear
[junit4:junit4]    > Cause: Annotated @Ignore(SOLR-2773: Non-Positive years don't work)
[junit4:junit4] Completed on J1 in 0.04s, 8 tests, 1 skipped
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.spelling.SpellingQueryConverterTest
[junit4:junit4] Completed on J0 in 0.03s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPortugueseStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.CloudStateTest
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestGermanLightStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.CSVParserTest
[junit4:junit4] Completed on J0 in 0.10s, 23 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.ExtendedBufferedReaderTest
[junit4:junit4] Completed on J1 in 0.05s, 8 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestStopFilterFactory
[junit4:junit4] Completed on J1 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapanesePartOfSpeechStopFilterFactory
[junit4:junit4] Completed on J0 in 0.36s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestElisionFilterFactory
[junit4:junit4] Completed on J1 in 0.03s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestFrenchMinimalStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestIndonesianStemFilterFactory
[junit4:junit4] Completed on J1 in 0.05s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestMappingCharFilterFactory
[junit4:junit4] Completed on J0 in 0.03s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestReverseStringFilterFactory
[junit4:junit4] Completed on J1 in 0.04s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestHindiFilters
[junit4:junit4] Completed on J0 in 0.03s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestTypeTokenFilterFactory
[junit4:junit4] Completed on J1 in 0.02s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestHungarianLightStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4] Completed on J1 in 0.00s, 0 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.CSVStrategyTest
[junit4:junit4] Completed on J0 in 0.01s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPatternTokenizerFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestCJKWidthFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestGreekStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPatternReplaceCharFilterFactory
[junit4:junit4] Completed on J0 in 0.03s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.util.TestUtils
[junit4:junit4] Completed on J1 in 0.01s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestEnglishMinimalStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestGermanStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPorterStemFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestTrimFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestDictionaryCompoundWordTokenFilterFactory
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
[junit4:junit4] Completed on J1 in 0.00s, 0 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.schema.PreAnalyzedFieldTest
[junit4:junit4] Completed on J0 in 0.04s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestPortugueseLightStemFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.ZkNodePropsTest
[junit4:junit4] Completed on J0 in 0.02s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.CSVUtilsTest
[junit4:junit4] Completed on J1 in 0.07s, 14 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestRemoveDuplicatesTokenFilterFactory
[junit4:junit4] Completed on J0 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestTurkishLowerCaseFilterFactory
[junit4:junit4] Completed on J1 in 0.01s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.writer.CSVWriterTest
[junit4:junit4] Completed on J0 in 0.01s, 2 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.internal.csv.writer.CSVConfigTest
[junit4:junit4] Completed on J1 in 0.01s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.analysis.TestJapaneseIterationMarkCharFilterFactory
[junit4:junit4] Completed on J1 in 0.05s, 4 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.cloud.ZkCLITest
[junit4:junit4] Completed on J1 in 2.41s, 3 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.AnalysisAfterCoreReloadTest
[junit4:junit4] Completed on J0 in 2.77s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestRTGBase
[junit4:junit4] Completed on J1 in 0.00s, 0 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestStressVersions
[junit4:junit4] Completed on J1 in 11.11s, 1 test
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.processor.ScriptEngineTest
[junit4:junit4] Completed on J1 in 0.21s, 5 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.update.processor.StatelessScriptUpdateProcessorFactoryTest
[junit4:junit4] Completed on J1 in 1.21s, 7 tests
[junit4:junit4]  
[junit4:junit4] Suite: org.apache.solr.search.TestStressRecovery
[junit4:junit4] Completed on J0 in 66.62s, 1 test
[junit4:junit4]  
[junit4:junit4] JVM J0:     0.82 ..  1300.59 =  1299.77s
[junit4:junit4] JVM J1:     0.83 ..   911.28 =   910.45s
[junit4:junit4] Execution time total: 21 minutes 40 seconds
[junit4:junit4] Tests summary: 297 suites, 1054 tests, 2 suite-level errors, 5 ignored

BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/build.xml:29: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/solr/build.xml:144: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/module-build.xml:62: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:1094: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk-java7/checkout/lucene/common-build.xml:789: There were test failures: 297 suites, 1054 tests, 2 suite-level errors, 5 ignored

Total time: 33 minutes 38 seconds
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]