[JENKINS] Lucene-Solr-BadApples-Tests-master - Build # 195 - Unstable

classic Classic list List threaded Threaded
37 messages Options
12
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-BadApples-Tests-master - Build # 215 - Still Unstable

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-BadApples-Tests-master/215/

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.prometheus.exporter.SolrExporterTest

Error Message:
Error from server at https://127.0.0.1:34057/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000000

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:34057/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000000
        at __randomizedtesting.SeedInfo.seed([95FFC6A58A5C2717]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at org.apache.solr.prometheus.exporter.SolrExporterTestBase.setupCluster(SolrExporterTestBase.java:48)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:875)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
max version bucket seed not updated after recovery!

Stack Trace:
java.lang.AssertionError: max version bucket seed not updated after recovery!
        at __randomizedtesting.SeedInfo.seed([FA93CFBC5D914971:72C7F066F36D2489]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.apache.solr.cloud.HttpPartitionTest.testRf2(HttpPartitionTest.java:290)
        at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:131)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup

Error Message:
java.util.concurrent.ExecutionException: org.apache.solr.common.SolrException: org.apache.solr.common.SolrException: Shard ScheduledMaintenanceTriggerTest_collection1 /  shard1 has no leader and can't be split

Stack Trace:
java.io.IOException: java.util.concurrent.ExecutionException: org.apache.solr.common.SolrException: org.apache.solr.common.SolrException: Shard ScheduledMaintenanceTriggerTest_collection1 /  shard1 has no leader and can't be split
        at __randomizedtesting.SeedInfo.seed([FA93CFBC5D914971:E7BF0FCE3CD26E7A]:0)
        at org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:654)
        at org.apache.solr.cloud.autoscaling.sim.SimCloudManager$1.request(SimCloudManager.java:224)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup(ScheduledMaintenanceTriggerTest.java:221)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.ExecutionException: org.apache.solr.common.SolrException: org.apache.solr.common.SolrException: Shard ScheduledMaintenanceTriggerTest_collection1 /  shard1 has no leader and can't be split
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.solr.cloud.autoscaling.sim.SimCloudManager.request(SimCloudManager.java:652)
        ... 43 more
Caused by: org.apache.solr.common.SolrException: org.apache.solr.common.SolrException: Shard ScheduledMaintenanceTriggerTest_collection1 /  shard1 has no leader and can't be split
        at org.apache.solr.cloud.autoscaling.sim.SimCloudManager.simHandleSolrRequest(SimCloudManager.java:854)
        at org.apache.solr.cloud.autoscaling.sim.SimCloudManager.lambda$request$15(SimCloudManager.java:651)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        ... 1 more
Caused by: org.apache.solr.common.SolrException: Shard ScheduledMaintenanceTriggerTest_collection1 /  shard1 has no leader and can't be split
        at org.apache.solr.cloud.autoscaling.sim.SimClusterStateProvider.simSplitShard(SimClusterStateProvider.java:1152)
        at org.apache.solr.cloud.autoscaling.sim.SimCloudManager.simHandleSolrRequest(SimCloudManager.java:852)
        ... 6 more




Build Log:
[...truncated 13908 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> 3084361 INFO  (SUITE-HttpPartitionTest-seed#[FA93CFBC5D914971]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/init-core-data-001
   [junit4]   2> 3084362 WARN  (SUITE-HttpPartitionTest-seed#[FA93CFBC5D914971]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=21 numCloses=21
   [junit4]   2> 3084362 INFO  (SUITE-HttpPartitionTest-seed#[FA93CFBC5D914971]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 3084363 INFO  (SUITE-HttpPartitionTest-seed#[FA93CFBC5D914971]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 3084363 INFO  (SUITE-HttpPartitionTest-seed#[FA93CFBC5D914971]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /kl_jg/e
   [junit4]   2> 3084375 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 3084375 INFO  (Thread-3526) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3084375 INFO  (Thread-3526) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 3084383 ERROR (Thread-3526) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3084475 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.ZkTestServer start zk server on port:35614
   [junit4]   2> 3084478 INFO  (zkConnectionManagerCallback-10308-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3084481 INFO  (zkConnectionManagerCallback-10310-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3084485 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 3084487 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 3084488 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3084489 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 3084511 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 3084512 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 3084514 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 3084515 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3084516 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3084517 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 3084518 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 3084519 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 3084777 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 3084790 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3084790 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3084790 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 3084792 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@20b3eac0{/kl_jg/e,null,AVAILABLE}
   [junit4]   2> 3084803 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@36c8e25a{HTTP/1.1,[http/1.1]}{127.0.0.1:43530}
   [junit4]   2> 3084803 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.Server Started @3085026ms
   [junit4]   2> 3084803 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/tempDir-001/control/data, hostContext=/kl_jg/e, hostPort=39644, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/control-001/cores}
   [junit4]   2> 3084803 ERROR (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3084803 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 3084804 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 3084804 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3084804 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3084804 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-11-20T16:43:00.839Z
   [junit4]   2> 3084805 INFO  (zkConnectionManagerCallback-10312-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3084831 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 3084831 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/control-001/solr.xml
   [junit4]   2> 3084834 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 3084834 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 3084836 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 3085074 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35614/solr
   [junit4]   2> 3085076 INFO  (zkConnectionManagerCallback-10316-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3085078 INFO  (zkConnectionManagerCallback-10318-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3085305 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39644_kl_jg%2Fe
   [junit4]   2> 3085306 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer Overseer (id=73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) starting
   [junit4]   2> 3085324 INFO  (zkConnectionManagerCallback-10325-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3085326 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35614/solr ready
   [junit4]   2> 3085327 INFO  (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:39644_kl_jg%2Fe
   [junit4]   2> 3085327 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39644_kl_jg%2Fe
   [junit4]   2> 3085327 DEBUG (OverseerAutoScalingTriggerThread-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 3085328 INFO  (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3085346 DEBUG (OverseerAutoScalingTriggerThread-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 3085346 INFO  (zkCallback-10324-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3085347 DEBUG (OverseerAutoScalingTriggerThread-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 3085347 DEBUG (OverseerAutoScalingTriggerThread-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 3085358 DEBUG (OverseerAutoScalingTriggerThread-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:39644_kl_jg%2Fe]
   [junit4]   2> 3085359 DEBUG (OverseerAutoScalingTriggerThread-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3085359 DEBUG (OverseerAutoScalingTriggerThread-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 3085359 DEBUG (ScheduledTrigger-7972-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 3085398 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 3085455 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3085480 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3085480 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3085481 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/control-001/cores
   [junit4]   2> 3085553 INFO  (zkConnectionManagerCallback-10331-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3085554 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3085554 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35614/solr ready
   [junit4]   2> 3085555 INFO  (SocketProxy-Acceptor-39644) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=44580,localport=39644], receiveBufferSize:531000
   [junit4]   2> 3085555 INFO  (SocketProxy-Acceptor-39644) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=43530,localport=50976], receiveBufferSize=530904
   [junit4]   2> 3085556 INFO  (qtp642322192-25150) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:39644_kl_jg%252Fe&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3085559 INFO  (OverseerThreadFactory-7974-thread-1-processing-n:127.0.0.1:39644_kl_jg%2Fe) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 3085561 DEBUG (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"control_collection",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "createNodeSet":"127.0.0.1:39644_kl_jg%2Fe",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 3085663 INFO  (SocketProxy-Acceptor-39644) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=44584,localport=39644], receiveBufferSize:531000
   [junit4]   2> 3085663 INFO  (SocketProxy-Acceptor-39644) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=43530,localport=50980], receiveBufferSize=530904
   [junit4]   2> 3085664 INFO  (qtp642322192-25145) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3085666 INFO  (SocketProxy-Acceptor-39644) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=44588,localport=39644], receiveBufferSize:531000
   [junit4]   2> 3085667 INFO  (SocketProxy-Acceptor-39644) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=43530,localport=50984], receiveBufferSize=530904
   [junit4]   2> 3085667 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe    x:control_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 3085667 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe    x:control_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 3085670 DEBUG (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"control_collection_shard1_replica_n1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:39644/kl_jg/e",
   [junit4]   2>   "node_name":"127.0.0.1:39644_kl_jg%2Fe",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 3086360 DEBUG (ScheduledTrigger-7972-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 3086695 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 3086716 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 3086971 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 3087009 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 3087010 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3087010 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 3087012 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=67.9287109375, floorSegmentMB=1.7666015625, forceMergeDeletesPctAllowed=15.880532373726545, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=47.74617908343414
   [junit4]   2> 3087013 WARN  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 3087103 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 3087104 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 3087105 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 3087105 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 3087105 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=19.0703125, floorSegmentMB=0.927734375, forceMergeDeletesPctAllowed=25.43163873321258, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7543890065591703, deletesPctAllowed=34.607443124905366
   [junit4]   2> 3087106 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3f7dbc23[control_collection_shard1_replica_n1] main]
   [junit4]   2> 3087107 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3087107 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3087116 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 3087116 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617671941679742976
   [junit4]   2> 3087116 INFO  (searcherExecutor-7979-thread-1-processing-n:127.0.0.1:39644_kl_jg%2Fe x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@3f7dbc23[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3087121 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 3087124 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 3087124 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 3087124 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:39644/kl_jg/e/control_collection_shard1_replica_n1/
   [junit4]   2> 3087124 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 3087125 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:39644/kl_jg/e/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 3087128 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:39644/kl_jg/e/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 3087128 DEBUG (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:39644/kl_jg/e",
   [junit4]   2>   "core":"control_collection_shard1_replica_n1",
   [junit4]   2>   "state":"active"} current state version: 0
   [junit4]   2> 3087230 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 3087231 DEBUG (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"control_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:39644/kl_jg/e",
   [junit4]   2>   "node_name":"127.0.0.1:39644_kl_jg%2Fe",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 3087232 INFO  (qtp642322192-25146) [n:127.0.0.1:39644_kl_jg%2Fe c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1565
   [junit4]   2> 3087251 INFO  (qtp642322192-25150) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 3087332 INFO  (zkCallback-10317-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3087361 DEBUG (ScheduledTrigger-7972-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 3087560 INFO  (OverseerCollectionConfigSetProcessor-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 3088251 INFO  (qtp642322192-25150) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:39644_kl_jg%252Fe&wt=javabin&version=2} status=0 QTime=2695
   [junit4]   2> 3088255 INFO  (zkConnectionManagerCallback-10336-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3088277 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3088278 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35614/solr ready
   [junit4]   2> 3088278 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 3088278 INFO  (SocketProxy-Acceptor-39644) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=44594,localport=39644], receiveBufferSize:531000
   [junit4]   2> 3088279 INFO  (SocketProxy-Acceptor-39644) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=43530,localport=50990], receiveBufferSize=530904
   [junit4]   2> 3088279 INFO  (qtp642322192-25149) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3088281 INFO  (OverseerThreadFactory-7974-thread-2-processing-n:127.0.0.1:39644_kl_jg%2Fe) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 3088284 DEBUG (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "createNodeSet":"",
   [junit4]   2>   "stateFormat":"1",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 3088361 DEBUG (ScheduledTrigger-7972-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 3088484 WARN  (OverseerThreadFactory-7974-thread-2-processing-n:127.0.0.1:39644_kl_jg%2Fe) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 3088487 INFO  (qtp642322192-25149) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 3088487 INFO  (qtp642322192-25149) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=207
   [junit4]   2> 3088785 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-1-001 of type NRT
   [junit4]   2> 3088785 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 3088786 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3088786 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3088786 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 3088787 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6d2e63c5{/kl_jg/e,null,AVAILABLE}
   [junit4]   2> 3088787 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@465ed0b3{HTTP/1.1,[http/1.1]}{127.0.0.1:41993}
   [junit4]   2> 3088787 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.Server Started @3089010ms
   [junit4]   2> 3088787 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/kl_jg/e, hostPort=38151, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-1-001/cores}
   [junit4]   2> 3088787 ERROR (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3088787 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 3088788 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 3088788 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3088788 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3088788 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-11-20T16:43:04.823Z
   [junit4]   2> 3088789 INFO  (zkConnectionManagerCallback-10338-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3088790 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 3088790 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-1-001/solr.xml
   [junit4]   2> 3088793 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 3088793 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 3088795 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 3088961 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35614/solr
   [junit4]   2> 3088965 INFO  (zkConnectionManagerCallback-10342-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3088967 INFO  (zkConnectionManagerCallback-10344-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3088992 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3088995 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 3088995 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38151_kl_jg%2Fe
   [junit4]   2> 3088996 DEBUG (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:38151_kl_jg%2Fe"} current state version: 1
   [junit4]   2> 3088996 INFO  (zkCallback-10335-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3088996 INFO  (zkCallback-10324-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3088996 INFO  (zkCallback-10317-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3088997 INFO  (zkCallback-10343-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3089058 INFO  (zkConnectionManagerCallback-10351-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3089059 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 3089060 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35614/solr ready
   [junit4]   2> 3089060 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 3089115 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3089146 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3089146 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3089147 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-1-001/cores
   [junit4]   2> 3089209 INFO  (SocketProxy-Acceptor-38151) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=48022,localport=38151], receiveBufferSize:531000
   [junit4]   2> 3089209 INFO  (SocketProxy-Acceptor-38151) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=41993,localport=40770], receiveBufferSize=530904
   [junit4]   2> 3089210 INFO  (qtp1032618628-25214) [n:127.0.0.1:38151_kl_jg%2Fe    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38151_kl_jg%252Fe&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3089212 INFO  (OverseerCollectionConfigSetProcessor-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 3089215 INFO  (SocketProxy-Acceptor-38151) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=48026,localport=38151], receiveBufferSize:531000
   [junit4]   2> 3089215 INFO  (SocketProxy-Acceptor-38151) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=41993,localport=40774], receiveBufferSize=530904
   [junit4]   2> 3089216 INFO  (qtp1032618628-25209) [n:127.0.0.1:38151_kl_jg%2Fe    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3089218 INFO  (qtp642322192-25151) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 3089219 INFO  (qtp642322192-25149) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3089219 INFO  (OverseerThreadFactory-7974-thread-3-processing-n:127.0.0.1:39644_kl_jg%2Fe) [n:127.0.0.1:39644_kl_jg%2Fe c:collection1 s:shard2  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:38151_kl_jg%2Fe for creating new replica of shard shard2 for collection collection1
   [junit4]   2> 3089221 INFO  (SocketProxy-Acceptor-38151) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=48030,localport=38151], receiveBufferSize:531000
   [junit4]   2> 3089239 INFO  (SocketProxy-Acceptor-38151) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=41993,localport=40778], receiveBufferSize=530904
   [junit4]   2> 3089239 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe    x:collection1_shard2_replica_n41] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 3089241 DEBUG (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1_shard2_replica_n41",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38151/kl_jg/e",
   [junit4]   2>   "node_name":"127.0.0.1:38151_kl_jg%2Fe",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 1
   [junit4]   2> 3089361 DEBUG (ScheduledTrigger-7972-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3090265 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 3090331 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
   [junit4]   2> 3090391 DEBUG (ScheduledTrigger-7972-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3090898 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 3090977 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
   [junit4]   2> 3090978 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3090978 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
   [junit4]   2> 3090980 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=67.9287109375, floorSegmentMB=1.7666015625, forceMergeDeletesPctAllowed=15.880532373726545, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=47.74617908343414
   [junit4]   2> 3090994 WARN  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 3091149 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 3091149 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 3091150 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 3091150 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 3091163 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=19.0703125, floorSegmentMB=0.927734375, forceMergeDeletesPctAllowed=25.43163873321258, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7543890065591703, deletesPctAllowed=34.607443124905366
   [junit4]   2> 3091163 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@4969720e[collection1_shard2_replica_n41] main]
   [junit4]   2> 3091165 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3091165 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3091165 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 3091166 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617671945926475776
   [junit4]   2> 3091166 INFO  (searcherExecutor-7993-thread-1-processing-n:127.0.0.1:38151_kl_jg%2Fe x:collection1_shard2_replica_n41 c:collection1 s:shard2) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@4969720e[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3091171 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node42=0}, version=0}
   [junit4]   2> 3091174 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 3091174 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 3091174 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38151/kl_jg/e/collection1_shard2_replica_n41/
   [junit4]   2> 3091174 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 3091174 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:38151/kl_jg/e/collection1_shard2_replica_n41/ has no replicas
   [junit4]   2> 3091185 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38151/kl_jg/e/collection1_shard2_replica_n41/ shard2
   [junit4]   2> 3091185 DEBUG (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "base_url":"http://127.0.0.1:38151/kl_jg/e",
   [junit4]   2>   "core":"collection1_shard2_replica_n41",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 3091336 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 3091338 INFO  (qtp1032618628-25210) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2098
   [junit4]   2> 3091354 DEBUG (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1_shard2_replica_n41",
   [junit4]   2>   "core_node_name":"core_node42",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38151/kl_jg/e",
   [junit4]   2>   "node_name":"127.0.0.1:38151_kl_jg%2Fe",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 3091355 INFO  (qtp1032618628-25214) [n:127.0.0.1:38151_kl_jg%2Fe c:collection1   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:38151_kl_jg%252Fe&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=2145
   [junit4]   2> 3091391 DEBUG (ScheduledTrigger-7972-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3091655 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-2-001 of type NRT
   [junit4]   2> 3091656 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 3091657 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 3091657 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 3091657 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 3091657 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@ca36cc8{/kl_jg/e,null,AVAILABLE}
   [junit4]   2> 3091658 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@73adbe6c{HTTP/1.1,[http/1.1]}{127.0.0.1:44808}
   [junit4]   2> 3091658 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.e.j.s.Server Started @3091881ms
   [junit4]   2> 3091658 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/kl_jg/e, hostPort=46464, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-2-001/cores}
   [junit4]   2> 3091658 ERROR (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3091659 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 3091659 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 3091659 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3091659 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3091659 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-11-20T16:43:07.694Z
   [junit4]   2> 3091660 INFO  (zkConnectionManagerCallback-10354-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3091661 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 3091661 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-2-001/solr.xml
   [junit4]   2> 3091665 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 3091665 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 3091678 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 3091842 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35614/solr
   [junit4]   2> 3091843 INFO  (zkConnectionManagerCallback-10358-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3091857 INFO  (zkConnectionManagerCallback-10360-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3091862 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 3091866 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 3091866 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46464_kl_jg%2Fe
   [junit4]   2> 3091867 DEBUG (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:46464_kl_jg%2Fe"} current state version: 4
   [junit4]   2> 3091867 INFO  (zkCallback-10324-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3091867 INFO  (zkCallback-10335-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3091867 INFO  (zkCallback-10350-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3091867 INFO  (zkCallback-10343-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3091867 INFO  (zkCallback-10317-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3091868 INFO  (zkCallback-10359-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 3091921 INFO  (zkConnectionManagerCallback-10367-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3091930 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 3091931 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35614/solr ready
   [junit4]   2> 3091932 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 3091965 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3092005 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3092005 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3092006 INFO  (TEST-HttpPartitionTest.test-seed#[FA93CFBC5D914971]) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-2-001/cores
   [junit4]   2> 3092101 INFO  (qtp1032618628-25209) [n:127.0.0.1:38151_kl_jg%2Fe    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46464_kl_jg%252Fe&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3092124 INFO  (OverseerCollectionConfigSetProcessor-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 3092127 INFO  (qtp1032618628-25213) [n:127.0.0.1:38151_kl_jg%2Fe    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.collection1.shard2.replica_n41:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 3092128 INFO  (qtp1032618628-25216) [n:127.0.0.1:38151_kl_jg%2Fe    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3092137 INFO  (qtp642322192-25151) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 3092138 INFO  (qtp642322192-25149) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3092139 INFO  (SocketProxy-Acceptor-46464) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=51970,localport=46464], receiveBufferSize:531000
   [junit4]   2> 3092139 INFO  (SocketProxy-Acceptor-46464) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44808,localport=55190], receiveBufferSize=530904
   [junit4]   2> 3092140 INFO  (qtp786686155-25258) [n:127.0.0.1:46464_kl_jg%2Fe    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 3092149 INFO  (OverseerThreadFactory-7974-thread-4-processing-n:127.0.0.1:39644_kl_jg%2Fe) [n:127.0.0.1:39644_kl_jg%2Fe c:collection1 s:shard1  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:46464_kl_jg%2Fe for creating new replica of shard shard1 for collection collection1
   [junit4]   2> 3092161 INFO  (SocketProxy-Acceptor-46464) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=51974,localport=46464], receiveBufferSize:531000
   [junit4]   2> 3092164 INFO  (SocketProxy-Acceptor-46464) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44808,localport=55194], receiveBufferSize=530904
   [junit4]   2> 3092177 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe    x:collection1_shard1_replica_n43] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 3092179 DEBUG (OverseerStateUpdate-73700554121150468-127.0.0.1:39644_kl_jg%2Fe-n_0000000000) [n:127.0.0.1:39644_kl_jg%2Fe    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1_shard1_replica_n43",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:46464/kl_jg/e",
   [junit4]   2>   "node_name":"127.0.0.1:46464_kl_jg%2Fe",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 4
   [junit4]   2> 3092392 DEBUG (ScheduledTrigger-7972-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3093220 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 3093253 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
   [junit4]   2> 3093392 DEBUG (ScheduledTrigger-7972-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3093591 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 3093637 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
   [junit4]   2> 3093638 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@63cdad84
   [junit4]   2> 3093638 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_FA93CFBC5D914971-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
   [junit4]   2> 3093640 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=67.9287109375, floorSegmentMB=1.7666015625, forceMergeDeletesPctAllowed=15.880532373726545, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=47.74617908343414
   [junit4]   2> 3093654 WARN  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 3093747 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 3093747 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 3093748 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 3093748 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 3093749 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=19.0703125, floorSegmentMB=0.927734375, forceMergeDeletesPctAllowed=25.43163873321258, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7543890065591703, deletesPctAllowed=34.607443124905366
   [junit4]   2> 3093749 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@13b1a36a[collection1_shard1_replica_n43] main]
   [junit4]   2> 3093750 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3093751 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3093751 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 3093751 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617671948637044736
   [junit4]   2> 3093752 INFO  (searcherExecutor-8007-thread-1-processing-n:127.0.0.1:46464_kl_jg%2Fe x:collection1_shard1_replica_n43 c:collection1 s:shard1) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@13b1a36a[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3093756 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node44=0}, version=0}
   [junit4]   2> 3093758 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 3093758 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 3093758 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46464/kl_jg/e/collection1_shard1_replica_n43/
   [junit4]   2> 3093758 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 3093758 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_kl_jg%2Fe c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:46464/kl_jg/e/collection1_shard1_replica_n43/ has no replicas
   [junit4]   2> 3093769 INFO  (qtp786686155-25253) [n:127.0.0.1:46464_

[...truncated too long message...]

-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null786163218
     [copy] Copying 240 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null786163218
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null786163218

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 72ms :: artifacts dl 2ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
        ---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 227 minutes 8 seconds
Archiving artifacts
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$34.hasMatch(FilePath.java:2678)
        at hudson.FilePath$34.invoke(FilePath.java:2557)
        at hudson.FilePath$34.invoke(FilePath.java:2547)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2918)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to lucene2
                at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:955)
                at hudson.FilePath.act(FilePath.java:1036)
                at hudson.FilePath.act(FilePath.java:1025)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
                at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1819)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2920)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath.act(FilePath.java:1038)
        at hudson.FilePath.act(FilePath.java:1025)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1819)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-BadApples-Tests-master - Build # 216 - Still Unstable

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-BadApples-Tests-master/216/

3 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration

Error Message:
did not finish processing in time

Stack Trace:
java.lang.AssertionError: did not finish processing in time
        at __randomizedtesting.SeedInfo.seed([39C0A1E2309D537:3A12B35E0CF61CC9]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration(IndexSizeTriggerTest.java:320)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration.testNodeMarkersRegistration

Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:10203_solr should have been deleted

Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:10203_solr should have been deleted
        at __randomizedtesting.SeedInfo.seed([39C0A1E2309D537:1B2682122D3C18D8]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertFalse(Assert.java:68)
        at org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration.testNodeMarkersRegistration(TestSimTriggerIntegration.java:893)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration.testEventFromRestoredState

Error Message:
The trigger did not fire at all

Stack Trace:
java.lang.AssertionError: The trigger did not fire at all
        at __randomizedtesting.SeedInfo.seed([39C0A1E2309D537:3AABEDE0A04715D]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration.testEventFromRestoredState(TestSimTriggerIntegration.java:723)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 15 lines...]
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
        at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:888)
        at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
        at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
        at hudson.scm.SCM.checkout(SCM.java:504)
        at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
        at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
        at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
        at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
        at hudson.model.Run.execute(Run.java:1794)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress git://git.apache.org/lucene-solr.git +refs/heads/*:refs/remotes/origin/*" returned status code 128:
stdout:
stderr: fatal: unable to connect to git.apache.org:
git.apache.org[0: 54.84.58.65]: errno=Connection refused


        at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2002)
        at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1721)
        at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:72)
        at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:405)
        at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
        at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
        Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to lucene2
                at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:955)
                at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
                at sun.reflect.GeneratedMethodAccessor1641.invoke(Unknown Source)
                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
                at java.lang.reflect.Method.invoke(Method.java:498)
                at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
                at com.sun.proxy.$Proxy119.execute(Unknown Source)
                at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:886)
                at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1155)
                at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1186)
                at hudson.scm.SCM.checkout(SCM.java:504)
                at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
                at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
                at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
                at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
                at hudson.model.Run.execute(Run.java:1794)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
ERROR: Error fetching remote repo 'origin'
Retrying after 10 seconds
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 67cdd21996f716ffb137bbcb8f826794a2632be7 (refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 67cdd21996f716ffb137bbcb8f826794a2632be7
Commit message: "SOLR-9856: Update the Ref Guide to no longer list this issue as unresolved."
 > git rev-list --no-walk bd3ce916bd1919576d9ced96e65182e850b3924c # timeout=10
No emails were triggered.
[Lucene-Solr-BadApples-Tests-master] $ /home/jenkins/tools/ant/apache-ant-1.8.4/bin/ant jenkins-badapples
Buildfile: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/build.xml

jenkins-badapples:

-print-java-info:
[java-info] java version "1.8.0_191"
[java-info] Java(TM) SE Runtime Environment (1.8.0_191-b12, Oracle Corporation)
[java-info] Java HotSpot(TM) 64-Bit Server VM (25.191-b12, Oracle Corporation)
[java-info] Test args: []

clean:

clean:

clean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 191ms :: artifacts dl 3ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
        ---------------------------------------------------------------------

-test-with-heapdumps-enabled:
     [echo] Java HotSpot(TM) 64-Bit Server VM: Enabling heap dumps on OutOfMemoryError to dir '/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/heapdumps'.
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/heapdumps

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve-groovy:

test:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

-clover.load:

resolve-groovy:

-init-totals:

test-core:

-clover.disable:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

-clover.load:

-clover.classpath:

-clover.setup:

clover:

-check-git-state:

-git-cleanroot:

-copy-git-state:
     [copy] Copying 1 file to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build

git-autoclean:

resolve:

init:

compile-core:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java
    [javac] Compiling 858 source files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/core/src/java/org/apache/lucene/index/FrozenBufferedUpdates.java:315: warning: [try] auto-closeable resource finalizer is never referenced in body of corresponding try statement
    [javac]         try (Closeable finalizer = () -> finishApply(writer, segStates, success.get(), delFiles)) {
    [javac]                        ^
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] 1 warning
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/util/graph/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/document/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/util/bkd/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/codecs/compressing/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene60/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/codecs/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene80/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/util/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/index/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/util/fst/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/analysis/tokenattributes/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/search/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/util/packed/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/util/mutable/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene70/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/codecs/perfield/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/analysis/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/analysis/standard/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/store/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/codecs/blocktree/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/search/spans/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/search/similarities/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/util/automaton/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/codecs/lucene50/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java/org/apache/lucene/geo/package-info.class
     [copy] Copying 3 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java

compile-test-framework:

-check-git-state:

-git-cleanroot:

-copy-git-state:

git-autoclean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

init:

compile-lucene-core:

-check-git-state:

-git-cleanroot:

-copy-git-state:

git-autoclean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

init:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

compile-core:

compile-codecs:

-check-git-state:

-git-cleanroot:

-copy-git-state:

git-autoclean:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

common.init:

compile-lucene-core:

init:

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

compile-core:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/codecs/classes/java
    [javac] Compiling 74 source files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/codecs/classes/java
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/codecs/classes/java/org/apache/lucene/codecs/bloom/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/codecs/classes/java/org/apache/lucene/codecs/memory/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/codecs/classes/java/org/apache/lucene/codecs/simpletext/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/codecs/classes/java/org/apache/lucene/codecs/blockterms/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/codecs/classes/java/org/apache/lucene/codecs/blocktreeords/package-info.class
     [copy] Copying 3 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/codecs/classes/java

-clover.disable:

-clover.load:

-clover.classpath:

-clover.setup:

clover:

common.compile-core:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/test-framework/classes/java
    [javac] Compiling 195 source files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/test-framework/classes/java
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/test-framework/src/java/org/apache/lucene/store/BaseDirectoryTestCase.java:416: warning: [try] auto-closeable resource output is never referenced in body of corresponding try statement
    [javac]             try (IndexOutput output = dir.createOutput(fileName, newIOContext(random()))) {
    [javac]                              ^
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/test-framework/src/java/org/apache/lucene/store/BaseDirectoryTestCase.java:440: warning: [try] auto-closeable resource input is never referenced in body of corresponding try statement
    [javac]                 try (IndexInput input = dir.openInput(file, newIOContext(random()))) {
    [javac]                                 ^
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/test-framework/src/java/org/apache/lucene/store/BaseDirectoryTestCase.java:1051: warning: [try] auto-closeable resource out is never referenced in body of corresponding try statement
    [javac]       try (IndexOutput out = dir.createOutput(name, IOContext.DEFAULT)) {
    [javac]                        ^
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/test-framework/src/java/org/apache/lucene/store/BaseDirectoryTestCase.java:1056: warning: [try] auto-closeable resource out is never referenced in body of corresponding try statement
    [javac]         try (IndexOutput out = dir.createOutput(name, IOContext.DEFAULT)) {
    [javac]                          ^
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] 4 warnings
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/asserting/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/ramonly/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/test-framework/classes/java/org/apache/lucene/mockfile/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/cheapbastard/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/mockrandom/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/cranky/package-info.class
    [javac] Creating empty /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/test-framework/classes/java/org/apache/lucene/codecs/compressing/dummy/package-info.class
     [copy] Copying 4 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/test-framework/classes/java

compile-core:

compile-test:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/test
    [javac] Compiling 522 source files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/test
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/core/src/test/org/apache/lucene/analysis/TestAnalyzerWrapper.java:52: warning: [try] auto-closeable resource ts is never referenced in body of corresponding try statement
    [javac]     try (TokenStream ts = wrapped.tokenStream("", "text")) {
    [javac]                      ^
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/core/src/test/org/apache/lucene/index/TestIndexWriter.java:2664: warning: [try] auto-closeable resource closeable is never referenced in body of corresponding try statement
    [javac]          Closeable closeable = () -> IOUtils.close(toClose)) {
    [javac]                    ^
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/core/src/test/org/apache/lucene/index/TestIndexWriter.java:3619: warning: [try] auto-closeable resource w is never referenced in body of corresponding try statement
    [javac]             try (IndexWriter w = new IndexWriter(dir, newIndexWriterConfig().setIndexCreatedVersionMajor(previousMajor))) {}
    [javac]                              ^
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/core/src/test/org/apache/lucene/index/TestIndexWriter.java:3622: warning: [try] auto-closeable resource w is never referenced in body of corresponding try statement
    [javac]             try (IndexWriter w = new IndexWriter(dir, newIndexWriterConfig().setOpenMode(openMode).setIndexCreatedVersionMajor(newMajor))) {}
    [javac]                              ^
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/core/src/test/org/apache/lucene/search/TestConstantScoreScorer.java:63: warning: [try] auto-closeable resource TestConstantScoreScorerIndex has a member method close() that could throw InterruptedException
    [javac]     try (TestConstantScoreScorerIndex index = new TestConstantScoreScorerIndex()) {
    [javac]                                       ^
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/core/src/test/org/apache/lucene/search/TestConstantScoreScorer.java:99: warning: [try] auto-closeable resource TestConstantScoreScorerIndex has a member method close() that could throw InterruptedException
    [javac]     try (TestConstantScoreScorerIndex index = new TestConstantScoreScorerIndex()) {
    [javac]                                       ^
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/core/src/test/org/apache/lucene/search/TestConstantScoreScorer.java:127: warning: [try] auto-closeable resource TestConstantScoreScorerIndex has a member method close() that could throw InterruptedException
    [javac]     try (TestConstantScoreScorerIndex index = new TestConstantScoreScorerIndex()) {
    [javac]                                       ^
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/core/src/test/org/apache/lucene/search/TestConstantScoreScorer.java:155: warning: [try] auto-closeable resource TestConstantScoreScorerIndex has a member method close() that could throw InterruptedException
    [javac]     try (TestConstantScoreScorerIndex index = new TestConstantScoreScorerIndex()) {
    [javac]                                       ^
    [javac] /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/core/src/test/org/apache/lucene/search/TestConstantScoreScorer.java:174: warning: [try] auto-closeable resource TestConstantScoreScorerIndex has a member method close() that could throw InterruptedException
    [javac]   static class TestConstantScoreScorerIndex implements AutoCloseable {
    [javac]          ^
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] 9 warnings
     [copy] Copying 3 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/test

-mrjar-classes-uptodate:

resolve-groovy:

patch-mrjar-classes:
[patch-cls] Remapped: org/apache/lucene/analysis/tokenattributes/CharTermAttributeImpl
[patch-cls] Remapped: org/apache/lucene/codecs/compressing/LZ4
[patch-cls] Remapped: org/apache/lucene/document/BinaryPoint$2
[patch-cls] Remapped: org/apache/lucene/document/DoubleRange
[patch-cls] Remapped: org/apache/lucene/document/FloatRange
[patch-cls] Remapped: org/apache/lucene/document/IntRange
[patch-cls] Remapped: org/apache/lucene/document/LatLonPointDistanceFeatureQuery$DistanceScorer$2
[patch-cls] Remapped: org/apache/lucene/document/LatLonPointDistanceQuery$1$2
[patch-cls] Remapped: org/apache/lucene/document/LatLonPointDistanceQuery$1$3
[patch-cls] Remapped: org/apache/lucene/document/LatLonPointInPolygonQuery$1$1
[patch-cls] Remapped: org/apache/lucene/document/LongDistanceFeatureQuery$DistanceScorer$2
[patch-cls] Remapped: org/apache/lucene/document/LongRange
[patch-cls] Remapped: org/apache/lucene/document/RangeFieldQuery$QueryType$1
[patch-cls] Remapped: org/apache/lucene/document/RangeFieldQuery$QueryType$2
[patch-cls] Remapped: org/apache/lucene/document/RangeFieldQuery$QueryType$3
[patch-cls] Remapped: org/apache/lucene/index/BitsSlice
[patch-cls] Remapped: org/apache/lucene/index/CheckIndex$VerifyPointsVisitor
[patch-cls] Remapped: org/apache/lucene/index/CodecReader
[patch-cls] Remapped: org/apache/lucene/index/MergeReaderWrapper
[patch-cls] Remapped: org/apache/lucene/index/PointValues
[patch-cls] Remapped: org/apache/lucene/search/BooleanScorer$TailPriorityQueue
[patch-cls] Remapped: org/apache/lucene/search/PointInSetQuery$SinglePointVisitor
[patch-cls] Remapped: org/apache/lucene/search/PointRangeQuery$1$1
[patch-cls] Remapped: org/apache/lucene/search/PointRangeQuery$1$2
[patch-cls] Remapped: org/apache/lucene/search/PointRangeQuery$1
[patch-cls] Remapped: org/apache/lucene/search/TopFieldCollector
[patch-cls] Remapped: org/apache/lucene/util/BytesRef
[patch-cls] Remapped: org/apache/lucene/util/BytesRefArray
[patch-cls] Remapped: org/apache/lucene/util/CharsRef$UTF16SortedAsUTF8Comparator
[patch-cls] Remapped: org/apache/lucene/util/CharsRef
[patch-cls] Remapped: org/apache/lucene/util/IntsRef
[patch-cls] Remapped: org/apache/lucene/util/LongsRef
[patch-cls] Remapped: org/apache/lucene/util/StringHelper
[patch-cls] Remapped: org/apache/lucene/util/automaton/Automaton$Builder
[patch-cls] Remapped: org/apache/lucene/util/automaton/Automaton
[patch-cls] Remapped: org/apache/lucene/util/bkd/BKDReader
[patch-cls] Remapped: org/apache/lucene/util/bkd/BKDWriter$BKDMergeQueue
[patch-cls] Remapped: org/apache/lucene/util/bkd/BKDWriter
[patch-cls] Remapped: org/apache/lucene/util/bkd/MutablePointsReaderUtils$1$1
[patch-cls] Remapped: org/apache/lucene/util/bkd/MutablePointsReaderUtils$2
[patch-cls] Remapped: org/apache/lucene/util/bkd/MutablePointsReaderUtils$3$1
[patch-cls] Remapped 41 class files for Java 9 to: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/classes/java9
    [touch] Creating /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/patch-mrjar.stamp

install-junit4-taskdef:

validate:

-init-totals:

-test:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/test
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/core/test/temp
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/.caches/test-stats/core
   [junit4] <JUnit4> says hallo! Master seed: B14501C625B860C1
   [junit4] Executing 511 suites with 3 JVMs.
   [junit4]
   [junit4] Started J2 PID([hidden email]).
   [junit4] Started J1 PID([hidden email]).
   [junit4] Started J0 PID([hidden email]).
   [junit4] Suite: org.apache.lucene.search.spans.TestSpanNearQuery
   [junit4] Completed [1/511] on J1 in 1.25s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.spans.TestSpanNotQuery
   [junit4] Completed [2/511] on J2 in 1.37s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestStringHelper
   [junit4] Completed [3/511] on J2 in 0.06s, 7 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestRoaringDocIdSet
   [junit4] Completed [4/511] on J2 in 0.58s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestOmitTf
   [junit4] Completed [5/511] on J0 in 2.21s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestConstantScoreQuery
   [junit4] Completed [6/511] on J2 in 0.35s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestParallelReaderEmptyIndex
   [junit4] Completed [7/511] on J2 in 0.33s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestMergedIterator
   [junit4] Completed [8/511] on J2 in 0.55s, 25 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestSparseFixedBitSet
   [junit4] Completed [9/511] on J1 in 3.24s, 11 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestRecyclingIntBlockAllocator
   [junit4] Completed [10/511] on J1 in 0.20s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestConjunctions
   [junit4] Completed [11/511] on J1 in 0.32s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestParallelLeafReader
   [junit4] Completed [12/511] on J1 in 0.95s, 10 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestMathUtil
   [junit4] Completed [13/511] on J1 in 0.08s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.geo.TestPolygon
   [junit4] Completed [14/511] on J1 in 0.07s, 15 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestAllFilesDetectTruncation
   [junit4] Completed [15/511] on J1 in 2.17s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.geo.TestPolygon2D
   [junit4] Completed [16/511] on J2 in 6.23s, 12 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestAllFilesHaveChecksumFooter
   [junit4] Completed [17/511] on J2 in 1.93s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestLiveFieldValues
   [junit4] Completed [18/511] on J2 in 1.60s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestFilterWeight
   [junit4] Completed [19/511] on J2 in 0.03s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.similarities.TestAxiomaticF2LOG
   [junit4] Completed [20/511] on J0 in 26.08s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestBlockPostingsFormat
   [junit4] Completed [21/511] on J2 in 69.60s, 28 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestRamUsageEstimator
   [junit4] IGNOR/A 0.04s J2 | TestRamUsageEstimator.testPrintValues
   [junit4]    > Assumption #1: Specify -Dtests.verbose=true to print constants of RamUsageEstimator.
   [junit4] Completed [22/511] on J2 in 0.23s, 5 tests, 1 skipped
   [junit4]
   [junit4] HEARTBEAT J1 PID([hidden email]): 2018-11-21T23:02:10, stalled for 61.7s at: TestLatLonPointQueries.testRandomDistance
   [junit4] Suite: org.apache.lucene.index.TestOmitPositions
   [junit4] Completed [23/511] on J2 in 1.07s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestBoostQuery
   [junit4] Completed [24/511] on J2 in 0.13s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestMultiDocValues
   [junit4] Completed [25/511] on J2 in 5.30s, 7 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexSorting
   [junit4] Completed [26/511] on J0 in 106.41s, 53 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.store.TestHugeRamFile
   [junit4] Completed [27/511] on J0 in 9.15s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestCrash
   [junit4] Completed [28/511] on J0 in 4.67s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestFieldInfos
   [junit4] Completed [29/511] on J0 in 0.68s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestSetOnce
   [junit4] Completed [30/511] on J0 in 1.04s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestDateSort
   [junit4] Completed [31/511] on J0 in 0.77s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.util.mutable.TestMutableValues
   [junit4] Completed [32/511] on J0 in 0.44s, 6 tests
   [junit4]
   [junit4] HEARTBEAT J2 PID([hidden email]): 2018-11-21T23:03:22, stalled for 64.9s at: TestAxiomaticF2EXP.testRandomScoring
   [junit4] Suite: org.apache.lucene.search.similarities.TestAxiomaticF2EXP
   [junit4] Completed [33/511] on J2 in 103.62s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.similarities.TestBooleanSimilarity
   [junit4] Completed [34/511] on J0 in 45.10s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestSort
   [junit4] Completed [35/511] on J0 in 2.54s, 25 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestTopDocsCollector
   [junit4] Completed [36/511] on J0 in 0.67s, 9 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestLSBRadixSorter
   [junit4] Completed [37/511] on J0 in 0.92s, 6 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestMaxPosition
   [junit4] Completed [38/511] on J0 in 0.51s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterDeleteByQuery
   [junit4] Completed [39/511] on J0 in 0.39s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexManyDocuments
   [junit4] Completed [40/511] on J0 in 5.43s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestBagOfPostings
   [junit4] Completed [41/511] on J0 in 23.16s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestDocsAndPositions
   [junit4] Completed [42/511] on J0 in 3.20s, 6 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestCharsRef
   [junit4] Completed [43/511] on J0 in 0.54s, 6 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestLatLonPointQueries
   [junit4] IGNOR/A 0.01s J1 | TestLatLonPointQueries.testRandomBig
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] IGNOR/A 0.00s J1 | TestLatLonPointQueries.testRandomDistanceHuge
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [44/511] on J1 in 229.52s, 41 tests, 2 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestFieldValueQuery
   [junit4] Completed [45/511] on J1 in 16.50s, 6 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.compressing.TestHighCompressionMode
   [junit4] Completed [46/511] on J1 in 4.14s, 7 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.bkd.TestDocIdsWriter
   [junit4] Completed [47/511] on J0 in 24.37s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestPendingDeletes
   [junit4] Completed [48/511] on J0 in 0.07s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestSoftDeletesDirectoryReaderWrapper
   [junit4] Completed [49/511] on J0 in 0.24s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestRadixSelector
   [junit4] Completed [50/511] on J1 in 1.59s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestOmitNorms
   [junit4] Completed [51/511] on J1 in 0.76s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestIntroSelector
   [junit4] Completed [52/511] on J0 in 1.49s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestLatLonPoint
   [junit4] Completed [53/511] on J0 in 0.06s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestIOUtils
   [junit4] Completed [54/511] on J0 in 0.25s, 19 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.TestStopFilter
   [junit4] Completed [55/511] on J0 in 0.07s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestPointQueries
   [junit4] IGNOR/A 0.00s J2 | TestPointQueries.testRandomBinaryBig
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] IGNOR/A 0.00s J2 | TestPointQueries.testRandomLongsBig
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [56/511] on J2 in 70.01s, 49 tests, 2 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestForUtil
   [junit4] Completed [57/511] on J2 in 0.10s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestBooleanScorer
   [junit4] Completed [58/511] on J1 in 4.18s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestRegexpRandom2
   [junit4] Completed [59/511] on J2 in 2.34s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestMixedDocValuesUpdates
   [junit4] IGNOR/A 0.00s J1 | TestMixedDocValuesUpdates.testTonsOfUpdates
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [60/511] on J1 in 3.77s, 10 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterWithThreads
   [junit4] Completed [61/511] on J2 in 2.87s, 14 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.store.TestRateLimiter
   [junit4] Completed [62/511] on J2 in 0.72s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestMultiPhraseEnum
   [junit4] Completed [63/511] on J2 in 0.06s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestElevationComparator
   [junit4] Completed [64/511] on J2 in 0.09s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestMatchAllDocsQuery
   [junit4] Completed [65/511] on J2 in 0.10s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.spans.TestBasics
   [junit4] Completed [66/511] on J2 in 3.57s, 27 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.Test2BPostings
   [junit4] IGNOR/A 0.00s J2 | Test2BPostings.test
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [67/511] on J2 in 0.03s, 1 test, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene60FieldInfoFormat
   [junit4] Completed [68/511] on J2 in 0.40s, 11 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestFutureObjects
   [junit4] Completed [69/511] on J2 in 0.05s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestUpgradeIndexMergePolicy
   [junit4] Completed [70/511] on J0 in 13.51s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestCodecs
   [junit4] Completed [71/511] on J0 in 0.61s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestMultiFields
   [junit4] Completed [72/511] on J0 in 0.70s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestStressIndexing
   [junit4] Completed [73/511] on J2 in 2.25s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestPayloadsOnVectors
   [junit4] Completed [74/511] on J2 in 0.07s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestTermVectors
   [junit4] Completed [75/511] on J0 in 0.67s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestParallelCompositeReader
   [junit4] Completed [76/511] on J0 in 0.68s, 11 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestUnicodeUtil
   [junit4] Completed [77/511] on J0 in 0.98s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestBooleanOr
   [junit4] Completed [78/511] on J0 in 2.02s, 7 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.tokenattributes.TestPackedTokenAttributeImpl
   [junit4] Completed [79/511] on J0 in 0.04s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterOnVMError
   [junit4] IGNOR/A 0.01s J0 | TestIndexWriterOnVMError.testCheckpoint
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [80/511] on J0 in 0.58s, 3 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.search.similarities.TestAxiomaticF1LOG
   [junit4] Completed [81/511] on J1 in 18.91s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestPhraseQuery
   [junit4] Completed [82/511] on J1 in 2.17s, 22 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestBlockPostingsFormat3
   [junit4] Completed [83/511] on J1 in 1.86s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestRegexpRandom
   [junit4] Completed [84/511] on J1 in 0.23s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterUnicode
   [junit4] Completed [85/511] on J1 in 3.35s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.store.TestRAMDirectory
   [junit4] IGNOR/A 0.00s J1 | TestRAMDirectory.testFsyncDoesntCreateNewFiles
   [junit4]    > Assumption #1: test only works for FSDirectory subclasses
   [junit4] IGNOR/A 0.02s J1 | TestRAMDirectory.testPendingDeletions
   [junit4]    > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
   [junit4] Completed [86/511] on J1 in 0.89s, 45 tests, 2 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestMultiCollector
   [junit4] Completed [87/511] on J1 in 0.25s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestEarlyTermination
   [junit4] Completed [88/511] on J1 in 0.07s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestLongValuesSource
   [junit4] Completed [89/511] on J1 in 1.66s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.similarities.TestSimilarityBase
   [junit4] Completed [90/511] on J1 in 0.53s, 27 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.Test2BPositions
   [junit4] IGNOR/A 0.00s J1 | Test2BPositions.test
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=uses lots of space and takes a few minutes))
   [junit4] Completed [91/511] on J1 in 0.04s, 1 test, 1 skipped
   [junit4]
   [junit4] HEARTBEAT J0 PID([hidden email]): 2018-11-21T23:06:35, stalled for 65.6s at: TestDistributionSPL.testRandomScoring
   [junit4] HEARTBEAT J2 PID([hidden email]): 2018-11-21T23:06:47, stalled for 61.3s at: TestLucene70DocValuesFormat.testTermsEnumLongSharedPrefixes
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50TermVectorsFormat
   [junit4] Completed [92/511] on J1 in 87.69s, 17 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestFutureArrays
   [junit4] Completed [93/511] on J1 in 1.19s, 10 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestStressDeletes
   [junit4] Completed [94/511] on J1 in 7.14s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestPayloads
   [junit4] Completed [95/511] on J1 in 1.27s, 7 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.similarities.TestDistributionSPL
   [junit4] Completed [96/511] on J0 in 123.17s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene70.TestIndexedDISI
   [junit4] Completed [97/511] on J1 in 24.80s, 10 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestCharsRefBuilder
   [junit4] Completed [98/511] on J1 in 0.17s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.store.TestLockFactory
   [junit4] Completed [99/511] on J1 in 0.27s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestTopDocsMerge
   [junit4] Completed [100/511] on J1 in 6.59s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.tokenattributes.TestBytesRefAttImpl
   [junit4] Completed [101/511] on J1 in 0.24s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterOutOfFileDescriptors
   [junit4] Completed [102/511] on J1 in 34.48s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterOnDiskFull
   [junit4] Completed [103/511] on J1 in 2.44s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.FuzzyTermOnShortTermsTest
   [junit4] Completed [104/511] on J1 in 0.66s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestLatLonPointDistanceFeatureQuery
   [junit4] Completed [105/511] on J1 in 12.06s, 8 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.store.TestFilterDirectory
   [junit4] IGNOR/A 0.09s J1 | TestFilterDirectory.testFsyncDoesntCreateNewFiles
   [junit4]    > Assumption #1: test only works for FSDirectory subclasses
   [junit4] IGNOR/A 0.00s J1 | TestFilterDirectory.testPendingDeletions
   [junit4]    > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
   [junit4] Completed [106/511] on J1 in 3.17s, 43 tests, 2 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene70.TestLucene70NormsFormat
   [junit4] IGNOR/A 0.00s J0 | TestLucene70NormsFormat.testSparseNCommonBig
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] IGNOR/A 0.00s J0 | TestLucene70NormsFormat.testNCommonBig
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] IGNOR/A 0.00s J0 | TestLucene70NormsFormat.testMergeStability
   [junit4]    > Assumption #1: The MockRandom PF randomizes content on the fly, so we can't check it
   [junit4] Completed [107/511] on J0 in 82.65s, 29 tests, 3 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestBooleanRewrites
   [junit4] Completed [108/511] on J0 in 3.29s, 12 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestMultiPhraseQuery
   [junit4] Completed [109/511] on J0 in 1.11s, 16 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestFloatRange
   [junit4] Completed [110/511] on J0 in 0.16s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestFixedBitSet
   [junit4] Completed [111/511] on J1 in 16.08s, 21 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestArrayUtil
   [junit4] Completed [112/511] on J0 in 18.36s, 15 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50CompoundFormat
   [junit4] Completed [113/511] on J0 in 26.15s, 26 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestAllFilesCheckIndexHeader
   [junit4] Completed [114/511] on J0 in 5.69s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestNeedsScores
   [junit4] Completed [115/511] on J0 in 0.69s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.automaton.TestAutomaton
   [junit4] Completed [116/511] on J0 in 17.13s, 56 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestAutomatonQueryUnicode
   [junit4] Completed [117/511] on J0 in 0.09s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestScoreCachingWrappingScorer
   [junit4] Completed [118/511] on J0 in 0.05s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestDocValuesQueries
   [junit4] Completed [119/511] on J0 in 7.83s, 10 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterMaxDocs
   [junit4] IGNOR/A 0.00s J0 | TestIndexWriterMaxDocs.testExactlyAtTrueLimit
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=takes over two hours))
   [junit4] Completed [120/511] on J0 in 2.63s, 21 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.index.Test2BPostingsBytes
   [junit4] IGNOR/A 0.00s J0 | Test2BPostingsBytes.test
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=takes ~20GB-30GB of space and 10 minutes))
   [junit4] Completed [121/511] on J0 in 0.01s, 1 test, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestWANDScorer
   [junit4] Completed [122/511] on J0 in 2.57s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.geo.TestGeoUtils
   [junit4] Completed [123/511] on J0 in 14.71s, 7 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestNeverDelete
   [junit4] Completed [124/511] on J0 in 3.25s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestBlockPostingsFormat2
   [junit4] Completed [125/511] on J0 in 4.03s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexableField
   [junit4] Completed [126/511] on J0 in 0.53s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestFlushByRamOrCountsPolicy
   [junit4] Completed [127/511] on J0 in 3.07s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestCollectionUtil
   [junit4] Completed [128/511] on J0 in 13.05s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestConjunctionDISI
   [junit4] Completed [129/511] on J0 in 18.61s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestTragicIndexWriterDeadlock
   [junit4] Completed [130/511] on J0 in 0.13s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.TestCodecUtil
   [junit4] Completed [131/511] on J0 in 0.17s, 16 tests
   [junit4]
   [junit4] HEARTBEAT J1 PID([hidden email]): 2018-11-21T23:11:23, stalled for 66.3s at: TestIndexingSequenceNumbers.testStressConcurrentAddAndDeleteAndCommit
   [junit4] Suite: org.apache.lucene.store.TestNativeFSLockFactory
   [junit4] IGNOR/A 0.00s J0 | TestNativeFSLockFactory.testStressLocks
   [junit4]    > Assumption #1: cannot handle buggy Files.delete
   [junit4] IGNOR/A 0.02s J0 | TestNativeFSLockFactory.testDeleteLockFile
   [junit4]    > Assumption #1: we must be able to delete an open file
   [junit4] Completed [132/511] on J0 in 12.80s, 11 tests, 2 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.store.TestBufferedIndexInput
   [junit4] Completed [133/511] on J0 in 1.71s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestStressIndexing2
   [junit4] Completed [134/511] on J0 in 7.95s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.spans.TestSpans
   [junit4] Completed [135/511] on J0 in 3.21s, 25 tests
   [junit4]
   [junit4] HEARTBEAT J2 PID([hidden email]): 2018-11-21T23:11:59, stalled for 71.3s at: TestLucene70DocValuesFormat.testTermsEnumVariableWidth
   [junit4] HEARTBEAT J1 PID([hidden email]): 2018-11-21T23:12:23, stalled for  126s at: TestIndexingSequenceNumbers.testStressConcurrentAddAndDeleteAndCommit
   [junit4] Suite: org.apache.lucene.index.TestIndexingSequenceNumbers
   [junit4] Completed [136/511] on J1 in 208.33s, 8 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestNumericDocValuesUpdates
   [junit4] Completed [137/511] on J0 in 62.82s, 32 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestDocValues
   [junit4] Completed [138/511] on J0 in 0.97s, 8 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestSearchWithThreads
   [junit4] Completed [139/511] on J0 in 8.85s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.TestCharArraySet
   [junit4] Completed [140/511] on J0 in 0.52s, 15 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestNoMergePolicy
   [junit4] Completed [141/511] on J0 in 0.40s, 7 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestFilterLeafReader
   [junit4] Completed [142/511] on J0 in 0.66s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestDateTools
   [junit4] Completed [143/511] on J0 in 0.44s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.Test2BTerms
   [junit4] IGNOR/A 0.00s J0 | Test2BTerms.test2BTerms
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=very slow, use 5g minimum heap))
   [junit4] Completed [144/511] on J0 in 0.06s, 1 test, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.search.similarities.TestAxiomaticSimilarity
   [junit4] Completed [145/511] on J0 in 0.13s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestDocumentsWriterStallControl
   [junit4] Completed [146/511] on J1 in 33.97s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.TestDemo
   [junit4] Completed [147/511] on J1 in 0.72s, 1 test
   [junit4]
   [junit4] HEARTBEAT J2 PID([hidden email]): 2018-11-21T23:13:23, stalled for 65.8s at: TestLucene70DocValuesFormat.testSortedNumericBlocksOfVariousBitsPerValue
   [junit4] Suite: org.apache.lucene.store.TestByteBuffersDirectory
   [junit4] IGNOR/A 0.04s J1 | TestByteBuffersDirectory.testPendingDeletions {impl=many buffers (heap)}
   [junit4]    > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
   [junit4] IGNOR/A 0.00s J1 | TestByteBuffersDirectory.testFsyncDoesntCreateNewFiles {impl=many buffers (heap)}
   [junit4]    > Assumption #1: test only works for FSDirectory subclasses
   [junit4] IGNOR/A 0.02s J1 | TestByteBuffersDirectory.testPendingDeletions {impl=byte array (heap)}
   [junit4]    > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
   [junit4] IGNOR/A 0.00s J1 | TestByteBuffersDirectory.testFsyncDoesntCreateNewFiles {impl=byte array (heap)}
   [junit4]    > Assumption #1: test only works for FSDirectory subclasses
   [junit4] IGNOR/A 0.10s J1 | TestByteBuffersDirectory.testPendingDeletions {impl=lucene's buffers (heap)}
   [junit4]    > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
   [junit4] IGNOR/A 0.05s J1 | TestByteBuffersDirectory.testFsyncDoesntCreateNewFiles {impl=lucene's buffers (heap)}
   [junit4]    > Assumption #1: test only works for FSDirectory subclasses
   [junit4] IGNOR/A 0.03s J1 | TestByteBuffersDirectory.testPendingDeletions {impl=one buffer (heap)}
   [junit4]    > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
   [junit4] IGNOR/A 0.02s J1 | TestByteBuffersDirectory.testFsyncDoesntCreateNewFiles {impl=one buffer (heap)}
   [junit4]    > Assumption #1: test only works for FSDirectory subclasses
   [junit4] Completed [148/511] on J1 in 14.60s, 168 tests, 8 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.tokenattributes.TestSimpleAttributeImpl
   [junit4] Completed [149/511] on J1 in 0.35s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.util.automaton.TestCompiledAutomaton
   [junit4] Completed [150/511] on J1 in 1.25s, 6 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.automaton.TestOperations
   [junit4] Completed [151/511] on J1 in 5.19s, 7 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestSloppyMath
   [junit4] Completed [152/511] on J1 in 7.59s, 8 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestDocument
   [junit4] Completed [153/511] on J1 in 1.07s, 12 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.spans.TestSpanSearchEquivalence
   [junit4] Completed [154/511] on J1 in 14.86s, 33 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestMaxTermFrequency
   [junit4] Completed [155/511] on J1 in 1.08s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestTransactionRollback
   [junit4] Completed [156/511] on J1 in 0.96s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestForTooMuchCloning
   [junit4] Completed [157/511] on J1 in 0.49s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.util.automaton.FiniteStringsIteratorTest
   [junit4] Completed [158/511] on J1 in 7.04s, 7 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene70.TestLucene70SegmentInfoFormat
   [junit4] Completed [159/511] on J1 in 2.77s, 16 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.TestCompetitiveFreqNormAccumulator
   [junit4] Completed [160/511] on J1 in 0.20s, 4 tests
   [junit4]
   [junit4] HEARTBEAT J0 PID([hidden email]): 2018-11-21T23:14:11, stalled for 71.0s at: TestAxiomaticF1EXP.testRandomScoring
   [junit4] Suite: org.apache.lucene.search.similarities.TestAxiomaticF1EXP
   [junit4] Completed [161/511] on J0 in 79.98s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestSubScorerFreqs
   [junit4] Completed [162/511] on J0 in 0.25s, 3 tests
   [junit4]
   [junit4] HEARTBEAT J2 PID([hidden email]): 2018-11-21T23:14:23, stalled for  126s at: TestLucene70DocValuesFormat.testSortedNumericBlocksOfVariousBitsPerValue
   [junit4] Suite: org.apache.lucene.analysis.TestGraphTokenizers
   [junit4] Completed [163/511] on J1 in 18.52s, 23 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestTerm
   [junit4] Completed [164/511] on J1 in 0.70s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestPrefixRandom
   [junit4] Completed [165/511] on J1 in 4.89s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestTerms
   [junit4] Completed [166/511] on J1 in 0.65s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestFilterCodecReader
   [junit4] Completed [167/511] on J1 in 0.22s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestCrashCausesCorruptIndex
   [junit4] Completed [168/511] on J1 in 2.38s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.Test4GBStoredFields
   [junit4] IGNOR/A 0.00s J1 | Test4GBStoredFields.test
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [169/511] on J1 in 0.05s, 1 test, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestTotalHitCountCollector
   [junit4] Completed [170/511] on J1 in 0.23s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestMultiLevelSkipList
   [junit4] Completed [171/511] on J1 in 0.69s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.util.fst.TestFSTs
   [junit4] IGNOR/A 0.00s J1 | TestFSTs.testBigSet
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [172/511] on J1 in 27.56s, 20 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestBoolean2ScorerSupplier
   [junit4] Completed [173/511] on J1 in 1.18s, 10 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.Test2BSortedDocValuesFixedSorted
   [junit4] IGNOR/A 0.02s J1 | Test2BSortedDocValuesFixedSorted.testFixedSorted
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=Takes ~ 6 hours if the heap is 5gb))
   [junit4] Completed [174/511] on J1 in 0.02s, 1 test, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestAtomicUpdate
   [junit4] Completed [175/511] on J1 in 4.29s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene70.TestLucene70DocValuesFormat
   [junit4] IGNOR/A 0.00s J2 | TestLucene70DocValuesFormat.testSortedSetVariableLengthManyVsStoredFields
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] IGNOR/A 0.00s J2 | TestLucene70DocValuesFormat.testSortedVariableLengthManyVsStoredFields
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] IGNOR/A 0.00s J2 | TestLucene70DocValuesFormat.testTermsEnumRandomMany
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [176/511] on J2 in 587.86s, 126 tests, 3 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestCloseableThreadLocal
   [junit4] Completed [177/511] on J2 in 0.03s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.store.TestMmapDirectory
   [junit4] Completed [178/511] on J2 in 1.07s, 42 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestTopFieldCollector
   [junit4] Completed [179/511] on J2 in 0.18s, 9 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.tokenattributes.TestCharTermAttributeImpl
   [junit4] Completed [180/511] on J2 in 0.52s, 13 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestPointValues
   [junit4] Completed [181/511] on J1 in 10.13s, 32 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestSortedSetSelector
   [junit4] Completed [182/511] on J1 in 0.14s, 15 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.similarities.TestIndependenceStandardized
   [junit4] Completed [183/511] on J0 in 59.24s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestFuzzyQuery
   [junit4] Completed [184/511] on J1 in 4.64s, 11 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestSimilarity
   [junit4] Completed [185/511] on J1 in 0.05s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterReader
   [junit4] IGNOR/A 0.00s J2 | TestIndexWriterReader.testDuringAddIndexes
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [186/511] on J2 in 10.25s, 23 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterOnJRECrash
   [junit4] IGNOR/A 0.00s J2 | TestIndexWriterOnJRECrash.testNRTThreads
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [187/511] on J2 in 0.01s, 1 test, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.search.MultiCollectorTest
   [junit4] Completed [188/511] on J2 in 0.05s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestLatLonPointDistanceSort
   [junit4] IGNOR/A 0.00s J2 | TestLatLonPointDistanceSort.testRandomHuge
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [189/511] on J2 in 1.54s, 4 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterExceptions
   [junit4] IGNOR/A 0.00s J1 | TestIndexWriterExceptions.testTooManyTokens
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [190/511] on J1 in 8.21s, 35 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestTwoPhaseCommitTool
   [junit4] Completed [191/511] on J1 in 0.04s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestField
   [junit4] Completed [192/511] on J1 in 0.13s, 23 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestReaderWrapperDVTypeCheck
   [junit4] Completed [193/511] on J1 in 0.04s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestCheckIndex
   [junit4] Completed [194/511] on J1 in 1.10s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.spans.TestFilterSpans
   [junit4] Completed [195/511] on J1 in 0.03s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.TestToken
   [junit4] Completed [196/511] on J1 in 0.03s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestNoMergeScheduler
   [junit4] Completed [197/511] on J1 in 0.05s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.store.TestGrowableByteArrayDataOutput
   [junit4] Completed [198/511] on J2 in 8.85s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestFixedLengthBytesRefArray
   [junit4] Completed [199/511] on J2 in 0.16s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestInfoStream
   [junit4] Completed [200/511] on J2 in 0.04s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestScorerPerf
   [junit4] Completed [201/511] on J1 in 3.78s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestReqOptSumScorer
   [junit4] Completed [202/511] on J1 in 0.93s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestOneMergeWrappingMergePolicy
   [junit4] Completed [203/511] on J1 in 0.03s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.TestAssertions
   [junit4] Completed [204/511] on J1 in 0.03s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.TestMergeSchedulerExternal
   [junit4] Completed [205/511] on J1 in 1.11s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.TestSearch
   [junit4] Completed [206/511] on J1 in 0.09s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.TestSearchForDuplicates
   [junit4] Completed [207/511] on J1 in 0.13s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.TestAnalyzerWrapper
   [junit4] Completed [208/511] on J1 in 0.03s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.TestCachingTokenFilter
   [junit4] Completed [209/511] on J1 in 0.05s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.TestCharArrayMap
   [junit4] Completed [210/511] on J1 in 0.16s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.TestCharFilter
   [junit4] Completed [211/511] on J1 in 0.04s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.TestCharacterUtils
   [junit4] Completed [212/511] on J1 in 0.04s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.TestDelegatingAnalyzerWrapper
   [junit4] Completed [213/511] on J1 in 0.06s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestDuelingCodecs
   [junit4] Completed [214/511] on J2 in 13.16s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.TestExternalCodecs
   [junit4] Completed [215/511] on J2 in 0.31s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.store.TestDirectory
   [junit4] IGNOR/A 0.00s J2 | TestDirectory.testListAll
   [junit4]    > Assumption #1: this test does not expect extra files
   [junit4] Completed [216/511] on J2 in 0.37s, 4 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.TestCodecLoadingDeadlock
   [junit4] Completed [217/511] on J2 in 0.87s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.util.automaton.TestDaciukMihovAutomatonBuilder
   [junit4] Completed [218/511] on J2 in 0.06s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.util.automaton.TestRegExp
   [junit4] Completed [219/511] on J2 in 0.13s, 6 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.util.TestSmallFloat
   [junit4] Completed [220/511] on J2 in 0.23s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestDoubleRange
   [junit4] Completed [221/511] on J2 in 0.06s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.spans.TestSpanTermQuery
   [junit4] Completed [222/511] on J2 in 0.02s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestMergeRateLimiter
   [junit4] Completed [223/511] on J2 in 0.01s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestTransactions
   [junit4] Completed [224/511] on J2 in 1.34s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestForceMergeForever
   [junit4] Completed [225/511] on J2 in 1.40s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.util.automaton.LimitedFiniteStringsIteratorTest
   [junit4] Completed [226/511] on J2 in 0.46s, 6 tests
   [junit4]
   [junit4] HEARTBEAT J0 PID([hidden email]): 2018-11-21T23:16:23, stalled for 63.4s at: TestBasicModelIF.testRandomScoring
   [junit4] Suite: org.apache.lucene.analysis.standard.TestStandardAnalyzer
   [junit4] Completed [227/511] on J1 in 46.27s, 36 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.compressing.TestFastDecompressionMode
   [junit4] Completed [228/511] on J1 in 12.76s, 11 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50LiveDocsFormat
   [junit4] IGNOR/A 0.00s J1 | TestLucene50LiveDocsFormat.testOverflow
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=Uses lots of memory))
   [junit4] Completed [229/511] on J1 in 0.38s, 4 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50StoredFieldsFormat
   [junit4] IGNOR/A 0.00s J1 | TestLucene50StoredFieldsFormat.testBigDocuments
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [230/511] on J1 in 8.88s, 17 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene50StoredFieldsFormatHighCompression
   [junit4] IGNOR/A 0.00s J1 | TestLucene50StoredFieldsFormatHighCompression.testBigDocuments
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [231/511] on J1 in 18.75s, 19 tests, 1 skipped
   [junit4]
   [junit4] HEARTBEAT J0 PID([hidden email]): 2018-11-21T23:17:23, stalled for  123s at: TestBasicModelIF.testRandomScoring
   [junit4] Suite: org.apache.lucene.codecs.lucene60.TestLucene60PointsFormat
   [junit4] IGNOR/A 0.00s J1 | TestLucene60PointsFormat.testRandomBinaryBig
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] IGNOR/A 0.07s J1 | TestLucene60PointsFormat.testMergeStability
   [junit4]    > Assumption #1: merge is not stable
   [junit4] Completed [232/511] on J1 in 21.26s, 20 tests, 2 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.search.similarities.TestBasicModelIF
   [junit4] Completed [233/511] on J0 in 165.70s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.perfield.TestPerFieldDocValuesFormat
   [junit4] Completed [234/511] on J2 in 190.27s, 110 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.compressing.TestFastCompressionMode
   [junit4] Completed [235/511] on J2 in 4.37s, 11 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.analysis.TestReusableStringReader
   [junit4] Completed [236/511] on J2 in 0.05s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestTermStates
   [junit4] Completed [237/511] on J2 in 0.15s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestQueryRescorer
   [junit4] Completed [238/511] on J2 in 1.48s, 6 tests
   [junit4]
   [junit4] HEARTBEAT J0 PID([hidden email]): 2018-11-21T23:19:11, stalled for 65.8s at: TestIndexWriterNRTIsCurrent.testIsCurrentWithThreads
   [junit4] Suite: org.apache.lucene.codecs.perfield.TestPerFieldPostingsFormat
   [junit4] IGNOR/A 0.07s J1 | TestPerFieldPostingsFormat.testMergeStability
   [junit4]    > Assumption #1: The MockRandom PF randomizes content on the fly, so we can't check it
   [junit4] IGNOR/A 0.15s J1 | TestPerFieldPostingsFormat.testPostingsEnumReuse
   [junit4]    > Assumption #1: The MockRandom PF randomizes content on the fly, so we can't check it
   [junit4] Completed [239/511] on J1 in 111.81s, 25 tests, 2 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.codecs.perfield.TestPerFieldPostingsFormat2
   [junit4] Completed [240/511] on J1 in 4.36s, 6 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestBinaryDocument
   [junit4] Completed [241/511] on J1 in 0.24s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestFeatureField
   [junit4] Completed [242/511] on J1 in 1.59s, 8 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestIntRange
   [junit4] Completed [243/511] on J1 in 0.34s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestLatLonDocValuesField
   [junit4] Completed [244/511] on J1 in 0.09s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestLongDistanceFeatureQuery
   [junit4] Completed [245/511] on J1 in 5.97s, 7 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.document.TestLongRange
   [junit4] Completed [246/511] on J1 in 0.18s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.geo.TestGeoEncodingUtils
   [junit4] Completed [247/511] on J1 in 4.19s, 3 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.Test2BDocs
   [junit4] IGNOR/A 0.00s J1 | Test2BDocs.test2BDocs
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=Takes ~30min))
   [junit4] Completed [248/511] on J1 in 0.04s, 1 test, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.index.Test2BNumericDocValues
   [junit4] IGNOR/A 0.00s J1 | Test2BNumericDocValues.testNumerics
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=takes ~ 2 hours if the heap is 5gb))
   [junit4] Completed [249/511] on J1 in 0.03s, 1 test, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.index.Test2BPoints
   [junit4] IGNOR/A 0.00s J1 | Test2BPoints.test2D
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=takes at least 4 hours and consumes many GB of temp disk space))
   [junit4] IGNOR/A 0.00s J1 | Test2BPoints.test1D
   [junit4]    > Assumption #1: 'monster' test group is disabled (@Monster(value=takes at least 4 hours and consumes many GB of temp disk space))
   [junit4] Completed [250/511] on J1 in 0.00s, 2 tests, 2 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestAllFilesHaveCodecHeader
   [junit4] Completed [251/511] on J1 in 1.37s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterNRTIsCurrent
   [junit4] Completed [252/511] on J0 in 108.66s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestIntBlockPool
   [junit4] Completed [253/511] on J0 in 2.22s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestBinaryDocValuesUpdates
   [junit4] IGNOR/A 0.00s J1 | TestBinaryDocValuesUpdates.testTonsOfUpdates
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] Completed [254/511] on J1 in 17.66s, 29 tests, 1 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestBinaryTerms
   [junit4] Completed [255/511] on J1 in 0.77s, 2 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestByteSlices
   [junit4] Completed [256/511] on J1 in 6.55s, 1 test
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestConcurrentMergeScheduler
   [junit4] Completed [257/511] on J1 in 7.53s, 16 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestConsistentFieldNumbers
   [junit4] Completed [258/511] on J1 in 1.55s, 4 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestCustomTermFreq
   [junit4] Completed [259/511] on J1 in 0.14s, 12 tests
   [junit4]
   [junit4] HEARTBEAT J2 PID([hidden email]): 2018-11-21T23:20:23, stalled for 67.9s at: TestTermsEnum.testVaryingTermsPerSegment
   [junit4] Suite: org.apache.lucene.index.TestDeletionPolicy
   [junit4] Completed [260/511] on J1 in 4.04s, 6 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestDemoParallelLeafReader
   [junit4] Completed [261/511] on J1 in 4.58s, 5 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.index.TestDirectoryReader
   [junit4] Completed [262/511] on J1 in 0.84s, 24 tests
   [junit4]
   [junit4] Suite: org.apache.lucene.search.TestLatLonDocValuesQueries
   [junit4] IGNOR/A 0.02s J0 | TestLatLonDocValuesQueries.testPolygonBasics
   [junit4]    > Assumption #1: Impl does not support polygons
   [junit4] IGNOR/A 0.00s J0 | TestLatLonDocValuesQueries.testPolygonNullField
   [junit4]    > Assumption #1: Impl does not support polygons
   [junit4] IGNOR/A 0.00s J0 | TestLatLonDocValuesQueries.testMultiPolygonBasics
   [junit4]    > Assumption #1: Impl does not support polygons
   [junit4] IGNOR/A 0.00s J0 | TestLatLonDocValuesQueries.testPolygonHole
   [junit4]    > Assumption #1: Impl does not support polygons
   [junit4] IGNOR/A 0.00s J0 | TestLatLonDocValuesQueries.testRandomDistanceHuge
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] IGNOR/A 0.01s J0 | TestLatLonDocValuesQueries.testSmallSetPoly
   [junit4]    > Assumption #1: Impl does not support polygons
   [junit4] IGNOR/A 0.00s J0 | TestLatLonDocValuesQueries.testSmallSetPolyWholeMap
   [junit4]    > Assumption #1: Impl does not support polygons
   [junit4] IGNOR/A 0.00s J0 | TestLatLonDocValuesQueries.testRandomBig
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4] IGNOR/A 0.00s J0 | TestLatLonDocValuesQueries.testPolygonHoleExcludes
   [junit4]    > Assumption #1: Impl does not support polygons
   [junit4] Completed [263/511] on J0 in 34.11s, 40 tests, 9 skipped
   [junit4]
   [junit4] Suite: org.apache.lucene.index.Test2BBinaryDocValues
   [

[...truncated too long message...]

pples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null1838660178
     [copy] Copying 240 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null1838660178
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null1838660178

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 72ms :: artifacts dl 18ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
        ---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 224 minutes 40 seconds
Archiving artifacts
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$34.hasMatch(FilePath.java:2678)
        at hudson.FilePath$34.invoke(FilePath.java:2557)
        at hudson.FilePath$34.invoke(FilePath.java:2547)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2918)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to lucene2
                at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:955)
                at hudson.FilePath.act(FilePath.java:1036)
                at hudson.FilePath.act(FilePath.java:1025)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
                at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1819)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2920)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath.act(FilePath.java:1038)
        at hudson.FilePath.act(FilePath.java:1025)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1819)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-BadApples-Tests-master - Build # 217 - Still Unstable

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-BadApples-Tests-master/217/

2 tests failed.
FAILED:  org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitMixedReplicaTypes

Error Message:
unexpected shard state expected:<inactive> but was:<active>

Stack Trace:
java.lang.AssertionError: unexpected shard state expected:<inactive> but was:<active>
        at __randomizedtesting.SeedInfo.seed([C632FBB1E18AA815:7EF1AF111D517D60]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.apache.solr.cloud.api.collections.ShardSplitTest.verifyShard(ShardSplitTest.java:378)
        at org.apache.solr.cloud.api.collections.ShardSplitTest.doSplitMixedReplicaTypes(ShardSplitTest.java:370)
        at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitMixedReplicaTypes(ShardSplitTest.java:336)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.client.solrj.impl.CloudSolrClientTest.testVersionsAreReturned

Error Message:
Error from server at http://127.0.0.1:35273/solr/collection1_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n3/update</title> </head> <body><h2>HTTP ERROR 404</h2> <p>Problem accessing /solr/collection1_shard2_replica_n3/update. Reason: <pre>    Can not find: /solr/collection1_shard2_replica_n3/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>  </body> </html>

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:35273/solr/collection1_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n3/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n3/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n3/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

        at __randomizedtesting.SeedInfo.seed([4D04B9B4CC4E1CD:FC16B2AEDFDD7905]:0)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:551)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1016)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:237)
        at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testVersionsAreReturned(CloudSolrClientTest.java:725)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35273/solr/collection1_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n3/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n3/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n3/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:528)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        ... 1 more




Build Log:
[...truncated 12797 lines...]
   [junit4] Suite: org.apache.solr.cloud.api.collections.ShardSplitTest
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/init-core-data-001
   [junit4]   2> 111184 WARN  (SUITE-ShardSplitTest-seed#[C632FBB1E18AA815]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=10 numCloses=10
   [junit4]   2> 111184 INFO  (SUITE-ShardSplitTest-seed#[C632FBB1E18AA815]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 111185 INFO  (SUITE-ShardSplitTest-seed#[C632FBB1E18AA815]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 111186 INFO  (SUITE-ShardSplitTest-seed#[C632FBB1E18AA815]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 111186 INFO  (SUITE-ShardSplitTest-seed#[C632FBB1E18AA815]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /zjp/cm
   [junit4]   2> 111240 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 111240 INFO  (Thread-41) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 111240 INFO  (Thread-41) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 111329 ERROR (Thread-41) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 111349 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.ZkTestServer start zk server on port:40663
   [junit4]   2> 111621 INFO  (zkConnectionManagerCallback-105-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 112104 INFO  (zkConnectionManagerCallback-107-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 112244 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 112266 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 112318 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 112319 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 112353 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 112389 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 112390 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 112411 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 112449 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 112501 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 112502 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 112573 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 115529 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 115670 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 115670 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 115670 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 115672 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7ad65f77{/zjp/cm,null,AVAILABLE}
   [junit4]   2> 115688 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3ac9ac4{HTTP/1.1,[http/1.1]}{127.0.0.1:43132}
   [junit4]   2> 115688 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.Server Started @115889ms
   [junit4]   2> 115688 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/tempDir-001/control/data, hostContext=/zjp/cm, hostPort=43132, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/control-001/cores}
   [junit4]   2> 115689 ERROR (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 115689 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 115689 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 115689 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 115689 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 115689 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-11-23T03:33:40.723Z
   [junit4]   2> 115814 INFO  (zkConnectionManagerCallback-109-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 115816 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 115816 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/control-001/solr.xml
   [junit4]   2> 115886 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 115887 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 115923 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1bd00247, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 120144 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40663/solr
   [junit4]   2> 120367 INFO  (zkConnectionManagerCallback-113-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 120467 INFO  (zkConnectionManagerCallback-115-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 121107 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43132_zjp%2Fcm
   [junit4]   2> 121108 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.Overseer Overseer (id=73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) starting
   [junit4]   2> 121223 INFO  (zkConnectionManagerCallback-122-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 121256 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40663/solr ready
   [junit4]   2> 121257 INFO  (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:43132_zjp%2Fcm
   [junit4]   2> 121259 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 121315 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43132_zjp%2Fcm
   [junit4]   2> 121330 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 121330 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 121330 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 121330 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 121330 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 121398 INFO  (zkCallback-114-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 121475 INFO  (zkCallback-121-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 121752 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 121987 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bd00247
   [junit4]   2> 122099 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bd00247
   [junit4]   2> 122099 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bd00247
   [junit4]   2> 122133 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/control-001/cores
   [junit4]   2> 122582 INFO  (zkConnectionManagerCallback-128-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 122640 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 122642 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40663/solr ready
   [junit4]   2> 122730 INFO  (qtp943941614-315) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43132_zjp%252Fcm&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 122803 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Got 1 tasks from work-queue : [[org.apache.solr.cloud.OverseerTaskQueue$QueueEvent@2e684ecf]]
   [junit4]   2> 122803 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000000] as running
   [junit4]   2> 122803 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>   "name":"control_collection",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "createNodeSet":"127.0.0.1:43132_zjp%2Fcm",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 123228 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Runner processing /overseer/collection-queue-work/qn-0000000000
   [junit4]   2> 123228 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
   [junit4]   2>   "name":"control_collection",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "createNodeSet":"127.0.0.1:43132_zjp%2Fcm",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 123228 INFO  (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 123228 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1
   [junit4]   2> 123228 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 123228 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 123229 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 123229 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 123267 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.OverseerCollectionMessageHandler creating collections conf node /collections/control_collection
   [junit4]   2> 123301 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.CreateCollectionCmd Check for collection zkNode:control_collection
   [junit4]   2> 123357 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.CreateCollectionCmd Collection zkNode exists
   [junit4]   2> 123512 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"control_collection",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "createNodeSet":"127.0.0.1:43132_zjp%2Fcm",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 123512 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 123605 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/control_collection/state.json
   [junit4]   2> 123664 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.Assign shardnames [shard1] NRT 1 TLOG 0 PULL 0 , policy null, nodeList [127.0.0.1:43132_zjp%2Fcm]
   [junit4]   2> 123725 INFO  (qtp943941614-310) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 123846 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.CreateCollectionCmd Creating SolrCores for new collection control_collection, shardNames [shard1] , message : {
   [junit4]   2>   "name":"control_collection",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "createNodeSet":"127.0.0.1:43132_zjp%2Fcm",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 123847 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.CreateCollectionCmd Creating core control_collection_shard1_replica_n1 as part of shard shard1 of collection control_collection on 127.0.0.1:43132_zjp%2Fcm
   [junit4]   2> 123915 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm    x:control_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 123915 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm    x:control_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 124227 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"control_collection_shard1_replica_n1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43132/zjp/cm",
   [junit4]   2>   "node_name":"127.0.0.1:43132_zjp%2Fcm",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 124227 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"control_collection_shard1_replica_n1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43132/zjp/cm",
   [junit4]   2>   "node_name":"127.0.0.1:43132_zjp%2Fcm",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 124229 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":"control_collection_shard1_replica_n1","base_url":"http://127.0.0.1:43132/zjp/cm","node_name":"127.0.0.1:43132_zjp%2Fcm","state":"down","type":"NRT"}
   [junit4]   2> 124229 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(control_collection//collections/control_collection/state.json/0)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":"control_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"http://127.0.0.1:43132/zjp/cm",
   [junit4]   2>           "node_name":"127.0.0.1:43132_zjp%2Fcm",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT"}}}}}
   [junit4]   2> 124373 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/control_collection/state.json version: 0
   [junit4]   2> 125233 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 125249 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1
   [junit4]   2> 125250 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 125250 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 125250 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 125250 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 125648 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 126185 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 126241 WARN  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieIntField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 126278 WARN  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieFloatField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 126293 WARN  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieLongField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 126314 WARN  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieDoubleField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 126454 WARN  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieDateField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 127250 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 127303 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1
   [junit4]   2> 127303 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 127303 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 127303 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 127303 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 127923 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 129223 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 129256 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bd00247
   [junit4]   2> 129304 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 129293 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 129321 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1
   [junit4]   2> 129321 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 129321 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 129321 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 129321 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 129521 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=75.68359375, floorSegmentMB=1.4287109375, forceMergeDeletesPctAllowed=28.75481494294015, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=48.95593824077901
   [junit4]   2> 129829 WARN  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 130666 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 130666 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 130667 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 130667 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 130681 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=77.5224609375, floorSegmentMB=0.5712890625, forceMergeDeletesPctAllowed=19.821680270097698, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.664180092250144, deletesPctAllowed=37.044170587641354
   [junit4]   2> 130866 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4c7f6c43[control_collection_shard1_replica_n1] main]
   [junit4]   2> 130953 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 130990 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 131065 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 131288 INFO  (searcherExecutor-99-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@4c7f6c43[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 131321 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 131339 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1
   [junit4]   2> 131339 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 131339 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 131339 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 131339 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 131358 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1617894085903777792
   [junit4]   2> 131483 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 131500 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 131500 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 131500 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43132/zjp/cm/control_collection_shard1_replica_n1/
   [junit4]   2> 131500 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 131501 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:43132/zjp/cm/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 131570 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43132/zjp/cm/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 131591 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:43132/zjp/cm",
   [junit4]   2>   "core":"control_collection_shard1_replica_n1",
   [junit4]   2>   "state":"active"} current state version: 0
   [junit4]   2> 131592 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/control_collection/state.json version: 1
   [junit4]   2> 131665 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 131681 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"control_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43132/zjp/cm",
   [junit4]   2>   "node_name":"127.0.0.1:43132_zjp%2Fcm",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 131681 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"control_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43132/zjp/cm",
   [junit4]   2>   "node_name":"127.0.0.1:43132_zjp%2Fcm",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 131681 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node2:{"core":"control_collection_shard1_replica_n1","base_url":"http://127.0.0.1:43132/zjp/cm","node_name":"127.0.0.1:43132_zjp%2Fcm","state":"active","type":"NRT","leader":"true"}
   [junit4]   2> 131682 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(control_collection//collections/control_collection/state.json/2)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":"control_collection_shard1_replica_n1",
   [junit4]   2>           "base_url":"http://127.0.0.1:43132/zjp/cm",
   [junit4]   2>           "node_name":"127.0.0.1:43132_zjp%2Fcm",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "leader":"true"}}}}}
   [junit4]   2> 131701 INFO  (qtp943941614-311) [n:127.0.0.1:43132_zjp%2Fcm c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=7787
   [junit4]   2> 131703 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.CreateCollectionCmd Finished create command on all shards for collection: control_collection
   [junit4]   2> 131703 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Completed task:[/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 131774 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000000] as completed.
   [junit4]   2> 131774 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 131774 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 131774 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 131775 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000000]
   [junit4]   2> 131775 DEBUG (OverseerThreadFactory-94-thread-1-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={127.0.0.1:43132_zjp%2Fcm={responseHeader={status=0,QTime=7787},core=control_collection_shard1_replica_n1}}}
   [junit4]   2> 131810 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/control_collection/state.json version: 2
   [junit4]   2> 131811 INFO  (zkCallback-114-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 131819 INFO  (qtp943941614-315) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 131819 INFO  (qtp943941614-315) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43132_zjp%252Fcm&wt=javabin&version=2} status=0 QTime=9089
   [junit4]   2> 132065 INFO  (zkConnectionManagerCallback-133-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 132067 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 132068 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40663/solr ready
   [junit4]   2> 132120 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 132139 INFO  (qtp943941614-310) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 132212 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Got 1 tasks from work-queue : [[org.apache.solr.cloud.OverseerTaskQueue$QueueEvent@2e684ed1]]
   [junit4]   2> 132212 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000002] as running
   [junit4]   2> 132212 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "createNodeSet":"",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 132227 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Runner processing /overseer/collection-queue-work/qn-0000000002
   [junit4]   2> 132228 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1
   [junit4]   2> 132228 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "createNodeSet":"",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 132229 INFO  (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 132229 INFO  (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 132230 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000002]
   [junit4]   2> 132230 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 132230 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 132230 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000002]
   [junit4]   2> 132248 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection1
   [junit4]   2> 132248 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.CreateCollectionCmd Check for collection zkNode:collection1
   [junit4]   2> 132249 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.CreateCollectionCmd Collection zkNode exists
   [junit4]   2> 132251 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "createNodeSet":"",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 132251 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 132431 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 132467 WARN  (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 132503 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.a.c.CreateCollectionCmd Finished create command for collection: collection1
   [junit4]   2> 132504 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Completed task:[/overseer/collection-queue-work/qn-0000000002]
   [junit4]   2> 132505 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000002] as completed.
   [junit4]   2> 132505 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 132505 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 132505 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: [/overseer/collection-queue-work/qn-0000000002]
   [junit4]   2> 132505 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000002]
   [junit4]   2> 132505 DEBUG (OverseerThreadFactory-94-thread-2-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Message id:/overseer/collection-queue-work/qn-0000000002 complete, response:{}
   [junit4]   2> 132506 INFO  (qtp943941614-310) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 132558 INFO  (qtp943941614-310) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=419
   [junit4]   2> 134244 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 134246 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 134246 INFO  (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 134247 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 134247 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 134247 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 134247 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 135460 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/shard-1-001 of type NRT
   [junit4]   2> 135461 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 135547 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 135547 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 135547 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 135548 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@50887ca6{/zjp/cm,null,AVAILABLE}
   [junit4]   2> 135549 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@72258019{HTTP/1.1,[http/1.1]}{127.0.0.1:38993}
   [junit4]   2> 135549 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.e.j.s.Server Started @135750ms
   [junit4]   2> 135549 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/zjp/cm, hostPort=38993, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/shard-1-001/cores}
   [junit4]   2> 135549 ERROR (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 135549 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 135549 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 135550 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 135550 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 135550 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-11-23T03:34:00.584Z
   [junit4]   2> 135701 INFO  (zkConnectionManagerCallback-135-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 135958 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 135958 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/shard-1-001/solr.xml
   [junit4]   2> 136017 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 136017 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 136051 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1bd00247, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 136253 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 136286 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 136286 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 136286 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 136286 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 136286 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 136598 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40663/solr
   [junit4]   2> 136699 INFO  (zkConnectionManagerCallback-139-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 137040 INFO  (zkConnectionManagerCallback-141-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 137096 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 137132 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 137132 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38993_zjp%2Fcm
   [junit4]   2> 137182 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:38993_zjp%2Fcm"} current state version: 0
   [junit4]   2> 137182 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:38993_zjp%2Fcm
   [junit4]   2> 137312 INFO  (zkCallback-140-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 137385 INFO  (zkCallback-132-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 137441 INFO  (zkCallback-121-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 137442 INFO  (zkCallback-114-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 137515 INFO  (zkConnectionManagerCallback-148-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 137532 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 137534 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40663/solr ready
   [junit4]   2> 137544 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 138165 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bd00247
   [junit4]   2> 138275 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bd00247
   [junit4]   2> 138275 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1bd00247
   [junit4]   2> 138289 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Got 0 tasks from work-queue : [[]]
   [junit4]   2> 138293 INFO  (TEST-ShardSplitTest.testSplitMixedReplicaTypes-seed#[C632FBB1E18AA815]) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.ShardSplitTest_C632FBB1E18AA815-001/shard-1-001/cores
   [junit4]   2> 138298 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 0
   [junit4]   2> 138298 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: []
   [junit4]   2> 138298 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 138298 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 138298 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: []
   [junit4]   2> 138665 INFO  (qtp1052090091-368) [n:127.0.0.1:38993_zjp%2Fcm    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38993_zjp%252Fcm&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 138789 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Got 1 tasks from work-queue : [[org.apache.solr.cloud.OverseerTaskQueue$QueueEvent@2e684ed3]]
   [junit4]   2> 138789 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Marked task [/overseer/collection-queue-work/qn-0000000004] as running
   [junit4]   2> 138789 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id:/overseer/collection-queue-work/qn-0000000004 message:{
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "node":"127.0.0.1:38993_zjp%2Fcm",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"addreplica"}
   [junit4]   2> 138845 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Cleaning up work-queue. #Running tasks: 1
   [junit4]   2> 138846 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningTasks: [/overseer/collection-queue-work/qn-0000000004]
   [junit4]   2> 138846 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor BlockedTasks: []
   [junit4]   2> 138846 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor CompletedTasks: []
   [junit4]   2> 138846 DEBUG (OverseerCollectionConfigSetProcessor-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor RunningZKTasks: [/overseer/collection-queue-work/qn-0000000004]
   [junit4]   2> 138849 DEBUG (OverseerThreadFactory-94-thread-3-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.OverseerTaskProcessor Runner processing /overseer/collection-queue-work/qn-0000000004
   [junit4]   2> 138849 DEBUG (OverseerThreadFactory-94-thread-3-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm c:collection1 s:shard2  ] o.a.s.c.a.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : addreplica , {
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "node":"127.0.0.1:38993_zjp%2Fcm",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"addreplica"}
   [junit4]   2> 138849 DEBUG (OverseerThreadFactory-94-thread-3-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm c:collection1 s:shard2  ] o.a.s.c.a.c.AddReplicaCmd addReplica() : {
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "node":"127.0.0.1:38993_zjp%2Fcm",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"addreplica"}
   [junit4]   2> 138850 DEBUG (OverseerThreadFactory-94-thread-3-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm c:collection1 s:shard2  ] o.a.s.c.a.c.Assign getNodesForNewReplicas() shard: shard2 , nrtReplicas : 1 , tlogReplicas: 0 , pullReplicas: 0 , createNodeSet 127.0.0.1:38993_zjp%2Fcm
   [junit4]   2> 138852 DEBUG (OverseerThreadFactory-94-thread-3-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm c:collection1 s:shard2  ] o.a.s.c.a.c.Assign shardnames [shard2] NRT 1 TLOG 0 PULL 0 , policy null, nodeList [127.0.0.1:38993_zjp%2Fcm]
   [junit4]   2> 138997 INFO  (qtp1052090091-363) [n:127.0.0.1:38993_zjp%2Fcm    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 139157 INFO  (qtp943941614-316) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=2
   [junit4]   2> 139213 INFO  (qtp943941614-316) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=22
   [junit4]   2> 139230 INFO  (OverseerThreadFactory-94-thread-3-processing-n:127.0.0.1:43132_zjp%2Fcm) [n:127.0.0.1:43132_zjp%2Fcm c:collection1 s:shard2  ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:38993_zjp%2Fcm for creating new replica of shard shard2 for collection collection1
   [junit4]   2> 139265 INFO  (qtp1052090091-364) [n:127.0.0.1:38993_zjp%2Fcm    x:collection1_shard2_replica_n41] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 139450 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0.1:43132_zjp%2Fcm-n_0000000000) [n:127.0.0.1:43132_zjp%2Fcm    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1_shard2_replica_n41",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38993/zjp/cm",
   [junit4]   2>   "node_name":"127.0.0.1:38993_zjp%2Fcm",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 139450 DEBUG (OverseerStateUpdate-73714436996333572-127.0.0

[...truncated too long message...]

pples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null2095014278
     [copy] Copying 240 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null2095014278
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null2095014278

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 127ms :: artifacts dl 1ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
        ---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 225 minutes 20 seconds
Archiving artifacts
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$34.hasMatch(FilePath.java:2678)
        at hudson.FilePath$34.invoke(FilePath.java:2557)
        at hudson.FilePath$34.invoke(FilePath.java:2547)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2918)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to lucene2
                at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:955)
                at hudson.FilePath.act(FilePath.java:1036)
                at hudson.FilePath.act(FilePath.java:1025)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
                at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1819)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2920)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath.act(FilePath.java:1038)
        at hudson.FilePath.act(FilePath.java:1025)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1819)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-BadApples-Tests-master - Build # 218 - Still Unstable

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-BadApples-Tests-master/218/

1 tests failed.
FAILED:  org.apache.solr.client.solrj.impl.CloudSolrClientTest.testVersionsAreReturned

Error Message:
Error from server at http://127.0.0.1:43312/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title> </head> <body><h2>HTTP ERROR 404</h2> <p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason: <pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>  </body> </html>

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:43312/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

        at __randomizedtesting.SeedInfo.seed([CCA395C785E523CA:34656CF216FCBB02]:0)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:551)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1016)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:237)
        at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testVersionsAreReturned(CloudSolrClientTest.java:725)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43312/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:528)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        ... 1 more




Build Log:
[...truncated 15949 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrClientTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.impl.CloudSolrClientTest_CCA395C785E523CA-001/init-core-data-001
   [junit4]   1> 12:32:39.376 [Thread-38] ERROR org.apache.zookeeper.server.ZooKeeperServer - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   1> 12:32:39.537 [jetty-launcher-45-thread-1] ERROR org.apache.solr.util.StartupLoggingUtils - Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> 12:32:39.543 [jetty-launcher-45-thread-3] ERROR org.apache.solr.util.StartupLoggingUtils - Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> 12:32:39.544 [jetty-launcher-45-thread-2] ERROR org.apache.solr.util.StartupLoggingUtils - Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> -
   [junit4]   1> replica:core_node3 rstate:active live:true
   [junit4]   1> replica:core_node5 rstate:active live:true
   [junit4]   1> replica:core_node6 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   1> 12:33:02.364 [qtp1189269764-222] ERROR org.apache.solr.handler.RequestHandlerBase - org.apache.solr.common.SolrException: Unknown action: foobar
   [junit4]   1> at org.apache.solr.handler.admin.ConfigSetsHandler.handleRequestBody(ConfigSetsHandler.java:109)
   [junit4]   1> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:734)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:715)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:496)
   [junit4]   1> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
   [junit4]   1> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   1> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
   [junit4]   1> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
   [junit4]   1> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:724)
   [junit4]   1> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   1> at org.eclipse.jetty.server.Server.handle(Server.java:531)
   [junit4]   1> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
   [junit4]   1> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
   [junit4]   1> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
   [junit4]   1> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   1> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
   [junit4]   1> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
   [junit4]   1> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
   [junit4]   1> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
   [junit4]   1> at java.lang.Thread.run(Thread.java:748)
   [junit4]   1>
   [junit4]   1> 12:33:02.392 [qtp1189269764-220] ERROR org.apache.solr.handler.RequestHandlerBase - org.apache.solr.common.SolrException: Unknown action: foobar
   [junit4]   1> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:241)
   [junit4]   1> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:734)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:715)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:496)
   [junit4]   1> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
   [junit4]   1> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   1> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
   [junit4]   1> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
   [junit4]   1> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:724)
   [junit4]   1> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   1> at org.eclipse.jetty.server.Server.handle(Server.java:531)
   [junit4]   1> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
   [junit4]   1> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
   [junit4]   1> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
   [junit4]   1> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   1> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
   [junit4]   1> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
   [junit4]   1> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
   [junit4]   1> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
   [junit4]   1> at java.lang.Thread.run(Thread.java:748)
   [junit4]   1>
   [junit4]   1> 12:33:02.421 [qtp1189269764-219] ERROR org.apache.solr.handler.RequestHandlerBase - org.apache.solr.common.SolrException: Unsupported operation: foobar
   [junit4]   1> at org.apache.solr.handler.admin.CoreAdminHandler.handleCustomAction(CoreAdminHandler.java:220)
   [junit4]   1> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:169)
   [junit4]   1> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:734)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:715)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:496)
   [junit4]   1> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
   [junit4]   1> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   1> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
   [junit4]   1> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
   [junit4]   1> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:724)
   [junit4]   1> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   1> at org.eclipse.jetty.server.Server.handle(Server.java:531)
   [junit4]   1> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
   [junit4]   1> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
   [junit4]   1> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
   [junit4]   1> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   1> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
   [junit4]   1> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
   [junit4]   1> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
   [junit4]   1> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
   [junit4]   1> at java.lang.Thread.run(Thread.java:748)
   [junit4]   1>
   [junit4]   1> -
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   1> -
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> replica:core_node4 rstate:down live:true
   [junit4]   1> -
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> replica:core_node4 rstate:recovering live:true
   [junit4]   1> -
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> replica:core_node4 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   1> -
   [junit4]   1> replica:core_node4 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   1> 12:33:23.720 [TEST-CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale-seed#[CCA395C785E523CA]] ERROR org.apache.solr.client.solrj.impl.CloudSolrClient - Request to collection [stale_state_test_col] failed due to (404) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45816/solr/stale_state_test_col_shard1_replica_n1: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   1> <head>
   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
   [junit4]   1> <title>Error 404 Can not find: /solr/stale_state_test_col_shard1_replica_n1/update</title>
   [junit4]   1> </head>
   [junit4]   1> <body><h2>HTTP ERROR 404</h2>
   [junit4]   1> <p>Problem accessing /solr/stale_state_test_col_shard1_replica_n1/update. Reason:
   [junit4]   1> <pre>    Can not find: /solr/stale_state_test_col_shard1_replica_n1/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>
   [junit4]   1>
   [junit4]   1> </body>
   [junit4]   1> </html>
   [junit4]   1> , retry? 0
   [junit4]   1> 12:33:29.892 [TEST-CloudSolrClientTest.testVersionsAreReturned-seed#[CCA395C785E523CA]] ERROR org.apache.solr.client.solrj.impl.CloudSolrClient - Request to collection [collection1] failed due to (404) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43312/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   1> <head>
   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
   [junit4]   1> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
   [junit4]   1> </head>
   [junit4]   1> <body><h2>HTTP ERROR 404</h2>
   [junit4]   1> <p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
   [junit4]   1> <pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>
   [junit4]   1>
   [junit4]   1> </body>
   [junit4]   1> </html>
   [junit4]   1> , retry? 0
   [junit4]   1> 12:33:29.909 [TEST-CloudSolrClientTest.testVersionsAreReturned-seed#[CCA395C785E523CA]] ERROR org.apache.solr.client.solrj.impl.CloudSolrClient - Request to collection [collection1] failed due to (404) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43312/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   1> <head>
   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
   [junit4]   1> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
   [junit4]   1> </head>
   [junit4]   1> <body><h2>HTTP ERROR 404</h2>
   [junit4]   1> <p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
   [junit4]   1> <pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>
   [junit4]   1>
   [junit4]   1> </body>
   [junit4]   1> </html>
   [junit4]   1> , retry? 1
   [junit4]   1> 12:33:29.921 [TEST-CloudSolrClientTest.testVersionsAreReturned-seed#[CCA395C785E523CA]] ERROR org.apache.solr.client.solrj.impl.CloudSolrClient - Request to collection [collection1] failed due to (404) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43312/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   1> <head>
   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
   [junit4]   1> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
   [junit4]   1> </head>
   [junit4]   1> <body><h2>HTTP ERROR 404</h2>
   [junit4]   1> <p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
   [junit4]   1> <pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>
   [junit4]   1>
   [junit4]   1> </body>
   [junit4]   1> </html>
   [junit4]   1> , retry? 2
   [junit4]   1> 12:33:29.926 [TEST-CloudSolrClientTest.testVersionsAreReturned-seed#[CCA395C785E523CA]] ERROR org.apache.solr.client.solrj.impl.CloudSolrClient - Request to collection [collection1] failed due to (404) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43312/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   1> <head>
   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
   [junit4]   1> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
   [junit4]   1> </head>
   [junit4]   1> <body><h2>HTTP ERROR 404</h2>
   [junit4]   1> <p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
   [junit4]   1> <pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>
   [junit4]   1>
   [junit4]   1> </body>
   [junit4]   1> </html>
   [junit4]   1> , retry? 3
   [junit4]   1> 12:33:29.936 [TEST-CloudSolrClientTest.testVersionsAreReturned-seed#[CCA395C785E523CA]] ERROR org.apache.solr.client.solrj.impl.CloudSolrClient - Request to collection [collection1] failed due to (404) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43312/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   1> <head>
   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
   [junit4]   1> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
   [junit4]   1> </head>
   [junit4]   1> <body><h2>HTTP ERROR 404</h2>
   [junit4]   1> <p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
   [junit4]   1> <pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>
   [junit4]   1>
   [junit4]   1> </body>
   [junit4]   1> </html>
   [junit4]   1> , retry? 4
   [junit4]   1> 12:33:29.941 [TEST-CloudSolrClientTest.testVersionsAreReturned-seed#[CCA395C785E523CA]] ERROR org.apache.solr.client.solrj.impl.CloudSolrClient - Request to collection [collection1] failed due to (404) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43312/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   1> <head>
   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
   [junit4]   1> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
   [junit4]   1> </head>
   [junit4]   1> <body><h2>HTTP ERROR 404</h2>
   [junit4]   1> <p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
   [junit4]   1> <pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>
   [junit4]   1>
   [junit4]   1> </body>
   [junit4]   1> </html>
   [junit4]   1> , retry? 5
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CloudSolrClientTest -Dtests.method=testVersionsAreReturned -Dtests.seed=CCA395C785E523CA -Dtests.multiplier=2 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=en-PH -Dtests.timezone=UTC -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   3.90s J0 | CloudSolrClientTest.testVersionsAreReturned <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:43312/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]    > <head>
   [junit4]    > <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
   [junit4]    > <title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
   [junit4]    > </head>
   [junit4]    > <body><h2>HTTP ERROR 404</h2>
   [junit4]    > <p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
   [junit4]    > <pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>
   [junit4]    > </body>
   [junit4]    > </html>
   [junit4]    > at __randomizedtesting.SeedInfo.seed([CCA395C785E523CA:34656CF216FCBB02]:0)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:551)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1016)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
   [junit4]    > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
   [junit4]    > at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:237)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testVersionsAreReturned(CloudSolrClientTest.java:725)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43312/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]    > <head>
   [junit4]    > <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
   [junit4]    > <title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
   [junit4]    > </head>
   [junit4]    > <body><h2>HTTP ERROR 404</h2>
   [junit4]    > <p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
   [junit4]    > <pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>
   [junit4]    > </body>
   [junit4]    > </html>
   [junit4]    > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
   [junit4]    > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:528)
   [junit4]    > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]    > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
   [junit4]    > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]    > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    > ... 1 more
   [junit4]   1> 12:33:36.921 [qtp1189269764-220] ERROR org.apache.solr.handler.RequestHandlerBase - org.apache.solr.common.SolrException: Collection: boguscollectionname not found
   [junit4]   1> at org.apache.solr.handler.admin.ClusterStatus.getClusterStatus(ClusterStatus.java:115)
   [junit4]   1> at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.lambda$static$22(CollectionsHandler.java:865)
   [junit4]   1> at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.execute(CollectionsHandler.java:1177)
   [junit4]   1> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:258)
   [junit4]   1> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:246)
   [junit4]   1> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:734)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:715)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:496)
   [junit4]   1> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
   [junit4]   1> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   1> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
   [junit4]   1> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
   [junit4]   1> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:724)
   [junit4]   1> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   1> at org.eclipse.jetty.server.Server.handle(Server.java:531)
   [junit4]   1> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
   [junit4]   1> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
   [junit4]   1> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
   [junit4]   1> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   1> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
   [junit4]   1> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
   [junit4]   1> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
   [junit4]   1> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
   [junit4]   1> at java.lang.Thread.run(Thread.java:748)
   [junit4]   1>
   [junit4]   1> 12:33:36.925 [qtp1189269764-222] ERROR org.apache.solr.handler.RequestHandlerBase - org.apache.solr.common.SolrException: Collection: boguscollectionname not found
   [junit4]   1> at org.apache.solr.handler.admin.ClusterStatus.getClusterStatus(ClusterStatus.java:115)
   [junit4]   1> at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.lambda$static$22(CollectionsHandler.java:865)
   [junit4]   1> at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation.execute(CollectionsHandler.java:1177)
   [junit4]   1> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:258)
   [junit4]   1> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:246)
   [junit4]   1> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:734)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:715)
   [junit4]   1> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:496)
   [junit4]   1> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
   [junit4]   1> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
   [junit4]   1> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1317)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
   [junit4]   1> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   1> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
   [junit4]   1> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1219)
   [junit4]   1> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
   [junit4]   1> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:724)
   [junit4]   1> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   1> at org.eclipse.jetty.server.Server.handle(Server.java:531)
   [junit4]   1> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352)
   [junit4]   1> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)
   [junit4]   1> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
   [junit4]   1> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   1> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
   [junit4]   1> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
   [junit4]   1> at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
   [junit4]   1> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)
   [junit4]   1> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)
   [junit4]   1> at java.lang.Thread.run(Thread.java:748)
   [junit4]   1>
   [junit4]   1> 12:33:37.048 [TEST-CloudSolrClientTest.testShutdown-seed#[CCA395C785E523CA]-SendThread(ff01::114:33332)] ERROR org.apache.zookeeper.ClientCnxnSocketNIO - Unable to open socket to ff01::114/ff01:0:0:0:0:0:0:114:33332
   [junit4]   1> 12:33:38.184 [TEST-CloudSolrClientTest.testShutdown-seed#[CCA395C785E523CA]-SendThread(ff01::114:33332)] ERROR org.apache.zookeeper.ClientCnxnSocketNIO - Unable to open socket to ff01::114/ff01:0:0:0:0:0:0:114:33332
   [junit4]   1> 12:33:47.845 [SUITE-CloudSolrClientTest-seed#[CCA395C785E523CA]-worker] ERROR org.apache.zookeeper.server.ZooKeeperServer - ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.impl.CloudSolrClientTest_CCA395C785E523CA-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): {multiDefault=PostingsFormat(name=MockRandom), a_t=PostingsFormat(name=MockRandom), title_s=PostingsFormat(name=MockRandom), id=PostingsFormat(name=LuceneVarGapFixedInterval), text=FST50}, docValues:{_version_=DocValuesFormat(name=Lucene70), multiDefault=DocValuesFormat(name=Lucene70), a_t=DocValuesFormat(name=Lucene70), title_s=DocValuesFormat(name=Lucene70), intDefault=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Asserting), text=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=157, maxMBSortInHeap=7.142983442150828, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@2af524fd), locale=en-PH, timezone=UTC
   [junit4]   2> NOTE: Linux 4.4.0-137-generic amd64/Oracle Corporation 1.8.0_191 (64-bit)/cpus=4,threads=1,free=257766464,total=430964736
   [junit4]   2> NOTE: All tests run in this JVM: [SolrExampleStreamingTest, HttpSolrClientSSLAuthConPoolTest, TestToleratedUpdateError, CloudSolrClientTest]
   [junit4] Completed [62/174 (1!)] on J0 in 69.01s, 16 tests, 1 error <<< FAILURES!

[...truncated 48109 lines...]
[asciidoctor:convert] asciidoctor: ERROR: about-this-guide.adoc: line 1: invalid part, must have at least one section (e.g., chapter, appendix, etc.)
[asciidoctor:convert] asciidoctor: ERROR: solr-glossary.adoc: line 1: invalid part, must have at least one section (e.g., chapter, appendix, etc.)
     [java] Processed 2440 links (1991 relative) to 3219 anchors in 248 files
     [echo] Validated Links & Anchors via: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-ref-guide/bare-bones-html/

-documentation-lint:
    [jtidy] Checking for broken html (such as invalid tags)...
   [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/build/jtidy_tmp
     [echo] Checking for broken links...
     [exec]
     [exec] Crawl/parse...
     [exec]
     [exec] Verify...
     [echo] Checking for malformed docs...

jar-checksums:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

common.resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/null195961826
     [copy] Copying 35 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/null195961826
   [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/null195961826

resolve-example:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

resolve-server:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null796867170
     [copy] Copying 240 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null796867170
   [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null796867170

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 29ms :: artifacts dl 2ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
        ---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 126 minutes 42 seconds
Archiving artifacts
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$34.hasMatch(FilePath.java:2678)
        at hudson.FilePath$34.invoke(FilePath.java:2557)
        at hudson.FilePath$34.invoke(FilePath.java:2547)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2918)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to lucene
                at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:955)
                at hudson.FilePath.act(FilePath.java:1036)
                at hudson.FilePath.act(FilePath.java:1025)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
                at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1819)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2920)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath.act(FilePath.java:1038)
        at hudson.FilePath.act(FilePath.java:1025)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1819)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-BadApples-Tests-master - Build # 219 - Still Unstable

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-BadApples-Tests-master/219/

3 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:38265/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:38265/collection1
        at __randomizedtesting.SeedInfo.seed([A5AE538B01BD2CCC:2DFA6C51AF414134]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at org.apache.solr.BaseDistributedSearchTestCase.add(BaseDistributedSearchTestCase.java:509)
        at org.apache.solr.BaseDistributedSearchTestCase.indexDoc(BaseDistributedSearchTestCase.java:498)
        at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:176)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
        at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
        at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
        at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
        at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
        at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
        at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
        at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
        at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
        at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
        at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
        at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
        at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
        at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
        at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
        ... 48 more


FAILED:  org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup

Error Message:
missing cleanup event: [CapturedEvent{timestamp=4293720689473424, stage=STARTED, actionName='null', event={   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",   "source":".scheduled_maintenance",   "eventTime":4293720686521851,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158938027,     "_enqueue_time_":4293720687554532}}, context={}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293720696068396, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",   "source":".scheduled_maintenance",   "eventTime":4293720686521851,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158938027,     "_enqueue_time_":4293720687554532}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293720701970255, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",   "source":".scheduled_maintenance",   "eventTime":4293720686521851,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158938027,     "_enqueue_time_":4293720687554532}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.inactive_shard_plan={staleLocks={ScheduledMaintenanceTriggerTest_collection1/staleShard-splitting={stateTimestamp=1542986137997200538, currentTimeNs=1543158938043149631, deltaSec=172800, ttlSec=20}}}, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293720703745443, stage=SUCCEEDED, actionName='null', event={   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",   "source":".scheduled_maintenance",   "eventTime":4293720686521851,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158938027,     "_enqueue_time_":4293720687554532}}, context={}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293725710158925, stage=STARTED, actionName='null', event={   "id":"f411eeba9c6f7Tcygsv8yw1dhe90l5lhirqx62l",   "source":".scheduled_maintenance",   "eventTime":4293725709256439,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158943050,     "_enqueue_time_":4293725709514092}}, context={}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293725713062470, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={   "id":"f411eeba9c6f7Tcygsv8yw1dhe90l5lhirqx62l",   "source":".scheduled_maintenance",   "eventTime":4293725709256439,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158943050,     "_enqueue_time_":4293725709514092}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293725716678501, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={   "id":"f411eeba9c6f7Tcygsv8yw1dhe90l5lhirqx62l",   "source":".scheduled_maintenance",   "eventTime":4293725709256439,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158943050,     "_enqueue_time_":4293725709514092}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293725718172374, stage=SUCCEEDED, actionName='null', event={   "id":"f411eeba9c6f7Tcygsv8yw1dhe90l5lhirqx62l",   "source":".scheduled_maintenance",   "eventTime":4293725709256439,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158943050,     "_enqueue_time_":4293725709514092}}, context={}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293730719627907, stage=STARTED, actionName='null', event={   "id":"f41201641236fTcygsv8yw1dhe90l5lhirqx62m",   "source":".scheduled_maintenance",   "eventTime":4293730718786415,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158948060,     "_enqueue_time_":4293730719079862}}, context={}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293730720460297, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={   "id":"f41201641236fTcygsv8yw1dhe90l5lhirqx62m",   "source":".scheduled_maintenance",   "eventTime":4293730718786415,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158948060,     "_enqueue_time_":4293730719079862}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293730729312711, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={   "id":"f41201641236fTcygsv8yw1dhe90l5lhirqx62m",   "source":".scheduled_maintenance",   "eventTime":4293730718786415,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158948060,     "_enqueue_time_":4293730719079862}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293730740948702, stage=SUCCEEDED, actionName='null', event={   "id":"f41201641236fTcygsv8yw1dhe90l5lhirqx62m",   "source":".scheduled_maintenance",   "eventTime":4293730718786415,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158948060,     "_enqueue_time_":4293730719079862}}, context={}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293735742561303, stage=STARTED, actionName='null', event={   "id":"f412141a2390bTcygsv8yw1dhe90l5lhirqx62n",   "source":".scheduled_maintenance",   "eventTime":4293735741536523,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158953083,     "_enqueue_time_":4293735741819394}}, context={}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293735743241938, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={   "id":"f412141a2390bTcygsv8yw1dhe90l5lhirqx62n",   "source":".scheduled_maintenance",   "eventTime":4293735741536523,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158953083,     "_enqueue_time_":4293735741819394}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293735745960661, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={   "id":"f412141a2390bTcygsv8yw1dhe90l5lhirqx62n",   "source":".scheduled_maintenance",   "eventTime":4293735741536523,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158953083,     "_enqueue_time_":4293735741819394}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293735747363232, stage=SUCCEEDED, actionName='null', event={   "id":"f412141a2390bTcygsv8yw1dhe90l5lhirqx62n",   "source":".scheduled_maintenance",   "eventTime":4293735741536523,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158953083,     "_enqueue_time_":4293735741819394}}, context={}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293740749028038, stage=STARTED, actionName='null', event={   "id":"f41226c0a444cTcygsv8yw1dhe90l5lhirqx62o",   "source":".scheduled_maintenance",   "eventTime":4293740747965516,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158958089,     "_enqueue_time_":4293740748345754}}, context={}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293740750003685, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={   "id":"f41226c0a444cTcygsv8yw1dhe90l5lhirqx62o",   "source":".scheduled_maintenance",   "eventTime":4293740747965516,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158958089,     "_enqueue_time_":4293740748345754}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293740752930276, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={   "id":"f41226c0a444cTcygsv8yw1dhe90l5lhirqx62o",   "source":".scheduled_maintenance",   "eventTime":4293740747965516,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158958089,     "_enqueue_time_":4293740748345754}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293740754390901, stage=SUCCEEDED, actionName='null', event={   "id":"f41226c0a444cTcygsv8yw1dhe90l5lhirqx62o",   "source":".scheduled_maintenance",   "eventTime":4293740747965516,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158958089,     "_enqueue_time_":4293740748345754}}, context={}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293745756340633, stage=STARTED, actionName='null', event={   "id":"f4123967ed9abTcygsv8yw1dhe90l5lhirqx62p",   "source":".scheduled_maintenance",   "eventTime":4293745755216299,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158963096,     "_enqueue_time_":4293745755487256}}, context={}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293745757077311, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={   "id":"f4123967ed9abTcygsv8yw1dhe90l5lhirqx62p",   "source":".scheduled_maintenance",   "eventTime":4293745755216299,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158963096,     "_enqueue_time_":4293745755487256}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293745759612583, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={   "id":"f4123967ed9abTcygsv8yw1dhe90l5lhirqx62p",   "source":".scheduled_maintenance",   "eventTime":4293745755216299,   "eventType":"SCHEDULED",   "properties":{     "actualEventTime":1543158963096,     "_enqueue_time_":4293745755487256}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.inactive_shard_plan={staleLocks={ScheduledMaintenanceTriggerTest_collection1/shard1-splitting={stateTimestamp=1543158938039221077, currentTimeNs=1543158963100303768, deltaSec=25, ttlSec=20}}}, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={   "trigger":".scheduled_maintenance",   "stage":[     "STARTED",     "ABORTED",     "SUCCEEDED",     "FAILED"],   "beforeAction":"inactive_shard_plan",   "afterAction":"inactive_shard_plan",   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}]

Stack Trace:
java.lang.AssertionError: missing cleanup event: [CapturedEvent{timestamp=4293720689473424, stage=STARTED, actionName='null', event={
  "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
  "source":".scheduled_maintenance",
  "eventTime":4293720686521851,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158938027,
    "_enqueue_time_":4293720687554532}}, context={}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293720696068396, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
  "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
  "source":".scheduled_maintenance",
  "eventTime":4293720686521851,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158938027,
    "_enqueue_time_":4293720687554532}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293720701970255, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={
  "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
  "source":".scheduled_maintenance",
  "eventTime":4293720686521851,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158938027,
    "_enqueue_time_":4293720687554532}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.inactive_shard_plan={staleLocks={ScheduledMaintenanceTriggerTest_collection1/staleShard-splitting={stateTimestamp=1542986137997200538, currentTimeNs=1543158938043149631, deltaSec=172800, ttlSec=20}}}, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293720703745443, stage=SUCCEEDED, actionName='null', event={
  "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
  "source":".scheduled_maintenance",
  "eventTime":4293720686521851,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158938027,
    "_enqueue_time_":4293720687554532}}, context={}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293725710158925, stage=STARTED, actionName='null', event={
  "id":"f411eeba9c6f7Tcygsv8yw1dhe90l5lhirqx62l",
  "source":".scheduled_maintenance",
  "eventTime":4293725709256439,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158943050,
    "_enqueue_time_":4293725709514092}}, context={}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293725713062470, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
  "id":"f411eeba9c6f7Tcygsv8yw1dhe90l5lhirqx62l",
  "source":".scheduled_maintenance",
  "eventTime":4293725709256439,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158943050,
    "_enqueue_time_":4293725709514092}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293725716678501, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={
  "id":"f411eeba9c6f7Tcygsv8yw1dhe90l5lhirqx62l",
  "source":".scheduled_maintenance",
  "eventTime":4293725709256439,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158943050,
    "_enqueue_time_":4293725709514092}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293725718172374, stage=SUCCEEDED, actionName='null', event={
  "id":"f411eeba9c6f7Tcygsv8yw1dhe90l5lhirqx62l",
  "source":".scheduled_maintenance",
  "eventTime":4293725709256439,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158943050,
    "_enqueue_time_":4293725709514092}}, context={}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293730719627907, stage=STARTED, actionName='null', event={
  "id":"f41201641236fTcygsv8yw1dhe90l5lhirqx62m",
  "source":".scheduled_maintenance",
  "eventTime":4293730718786415,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158948060,
    "_enqueue_time_":4293730719079862}}, context={}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293730720460297, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
  "id":"f41201641236fTcygsv8yw1dhe90l5lhirqx62m",
  "source":".scheduled_maintenance",
  "eventTime":4293730718786415,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158948060,
    "_enqueue_time_":4293730719079862}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293730729312711, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={
  "id":"f41201641236fTcygsv8yw1dhe90l5lhirqx62m",
  "source":".scheduled_maintenance",
  "eventTime":4293730718786415,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158948060,
    "_enqueue_time_":4293730719079862}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293730740948702, stage=SUCCEEDED, actionName='null', event={
  "id":"f41201641236fTcygsv8yw1dhe90l5lhirqx62m",
  "source":".scheduled_maintenance",
  "eventTime":4293730718786415,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158948060,
    "_enqueue_time_":4293730719079862}}, context={}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293735742561303, stage=STARTED, actionName='null', event={
  "id":"f412141a2390bTcygsv8yw1dhe90l5lhirqx62n",
  "source":".scheduled_maintenance",
  "eventTime":4293735741536523,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158953083,
    "_enqueue_time_":4293735741819394}}, context={}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293735743241938, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
  "id":"f412141a2390bTcygsv8yw1dhe90l5lhirqx62n",
  "source":".scheduled_maintenance",
  "eventTime":4293735741536523,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158953083,
    "_enqueue_time_":4293735741819394}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293735745960661, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={
  "id":"f412141a2390bTcygsv8yw1dhe90l5lhirqx62n",
  "source":".scheduled_maintenance",
  "eventTime":4293735741536523,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158953083,
    "_enqueue_time_":4293735741819394}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293735747363232, stage=SUCCEEDED, actionName='null', event={
  "id":"f412141a2390bTcygsv8yw1dhe90l5lhirqx62n",
  "source":".scheduled_maintenance",
  "eventTime":4293735741536523,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158953083,
    "_enqueue_time_":4293735741819394}}, context={}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293740749028038, stage=STARTED, actionName='null', event={
  "id":"f41226c0a444cTcygsv8yw1dhe90l5lhirqx62o",
  "source":".scheduled_maintenance",
  "eventTime":4293740747965516,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158958089,
    "_enqueue_time_":4293740748345754}}, context={}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293740750003685, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
  "id":"f41226c0a444cTcygsv8yw1dhe90l5lhirqx62o",
  "source":".scheduled_maintenance",
  "eventTime":4293740747965516,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158958089,
    "_enqueue_time_":4293740748345754}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293740752930276, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={
  "id":"f41226c0a444cTcygsv8yw1dhe90l5lhirqx62o",
  "source":".scheduled_maintenance",
  "eventTime":4293740747965516,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158958089,
    "_enqueue_time_":4293740748345754}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293740754390901, stage=SUCCEEDED, actionName='null', event={
  "id":"f41226c0a444cTcygsv8yw1dhe90l5lhirqx62o",
  "source":".scheduled_maintenance",
  "eventTime":4293740747965516,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158958089,
    "_enqueue_time_":4293740748345754}}, context={}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293745756340633, stage=STARTED, actionName='null', event={
  "id":"f4123967ed9abTcygsv8yw1dhe90l5lhirqx62p",
  "source":".scheduled_maintenance",
  "eventTime":4293745755216299,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158963096,
    "_enqueue_time_":4293745755487256}}, context={}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293745757077311, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
  "id":"f4123967ed9abTcygsv8yw1dhe90l5lhirqx62p",
  "source":".scheduled_maintenance",
  "eventTime":4293745755216299,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158963096,
    "_enqueue_time_":4293745755487256}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}, CapturedEvent{timestamp=4293745759612583, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={
  "id":"f4123967ed9abTcygsv8yw1dhe90l5lhirqx62p",
  "source":".scheduled_maintenance",
  "eventTime":4293745755216299,
  "eventType":"SCHEDULED",
  "properties":{
    "actualEventTime":1543158963096,
    "_enqueue_time_":4293745755487256}}, context={properties.BEFORE_ACTION=[inactive_shard_plan, execute_plan, test], source=.scheduled_maintenance, properties.inactive_shard_plan={staleLocks={ScheduledMaintenanceTriggerTest_collection1/shard1-splitting={stateTimestamp=1543158938039221077, currentTimeNs=1543158963100303768, deltaSec=25, ttlSec=20}}}, properties.AFTER_ACTION=[inactive_shard_plan, execute_plan, test]}, config={
  "trigger":".scheduled_maintenance",
  "stage":[
    "STARTED",
    "ABORTED",
    "SUCCEEDED",
    "FAILED"],
  "beforeAction":"inactive_shard_plan",
  "afterAction":"inactive_shard_plan",
  "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}]
        at __randomizedtesting.SeedInfo.seed([A5AE538B01BD2CCC:B88293F960FE0BC7]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest.testInactiveShardCleanup(ScheduledMaintenanceTriggerTest.java:253)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.client.solrj.impl.CloudSolrClientTest.testParallelUpdateQTime

Error Message:
Error from server at http://127.0.0.1:37432/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> <title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title> </head> <body><h2>HTTP ERROR 404</h2> <p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason: <pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>  </body> </html>

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:37432/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

        at __randomizedtesting.SeedInfo.seed([E693D6EC3BE00C20:84BAD7D759FD9B3]:0)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:551)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1016)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:949)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testParallelUpdateQTime(CloudSolrClientTest.java:146)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37432/solr/collection1_shard2_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Can not find: /solr/collection1_shard2_replica_n2/update</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/collection1_shard2_replica_n2/update. Reason:
<pre>    Can not find: /solr/collection1_shard2_replica_n2/update</pre></p><hr><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.4.11.v20180605</a><hr/>

</body>
</html>

        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:528)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        ... 1 more




Build Log:
[...truncated 12803 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_A5AE538B01BD2CCC-001/init-core-data-001
   [junit4]   2> 351358 WARN  (SUITE-ScheduledMaintenanceTriggerTest-seed#[A5AE538B01BD2CCC]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 351358 INFO  (SUITE-ScheduledMaintenanceTriggerTest-seed#[A5AE538B01BD2CCC]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 351361 INFO  (SUITE-ScheduledMaintenanceTriggerTest-seed#[A5AE538B01BD2CCC]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 351361 INFO  (SUITE-ScheduledMaintenanceTriggerTest-seed#[A5AE538B01BD2CCC]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 351361 INFO  (SUITE-ScheduledMaintenanceTriggerTest-seed#[A5AE538B01BD2CCC]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_A5AE538B01BD2CCC-001/tempDir-001
   [junit4]   2> 351361 INFO  (SUITE-ScheduledMaintenanceTriggerTest-seed#[A5AE538B01BD2CCC]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 351362 INFO  (Thread-942) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 351362 INFO  (Thread-942) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 351367 ERROR (Thread-942) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 351462 INFO  (SUITE-ScheduledMaintenanceTriggerTest-seed#[A5AE538B01BD2CCC]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:43615
   [junit4]   2> 351465 INFO  (zkConnectionManagerCallback-890-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 351469 INFO  (jetty-launcher-887-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 351470 INFO  (jetty-launcher-887-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 351471 INFO  (jetty-launcher-887-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 351471 INFO  (jetty-launcher-887-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 351471 INFO  (jetty-launcher-887-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5765a299{/solr,null,AVAILABLE}
   [junit4]   2> 351473 INFO  (jetty-launcher-887-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@30360f25{HTTP/1.1,[http/1.1]}{127.0.0.1:43927}
   [junit4]   2> 351473 INFO  (jetty-launcher-887-thread-1) [    ] o.e.j.s.Server Started @351527ms
   [junit4]   2> 351473 INFO  (jetty-launcher-887-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43927}
   [junit4]   2> 351474 ERROR (jetty-launcher-887-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 351474 INFO  (jetty-launcher-887-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 351474 INFO  (jetty-launcher-887-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 351474 INFO  (jetty-launcher-887-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 351474 INFO  (jetty-launcher-887-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 351474 INFO  (jetty-launcher-887-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-11-25T15:15:34.853Z
   [junit4]   2> 351476 INFO  (zkConnectionManagerCallback-892-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 351477 INFO  (jetty-launcher-887-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 351694 INFO  (jetty-launcher-887-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43615/solr
   [junit4]   2> 351696 INFO  (zkConnectionManagerCallback-896-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 351699 INFO  (zkConnectionManagerCallback-898-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 351813 INFO  (jetty-launcher-887-thread-1) [n:127.0.0.1:43927_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43927_solr
   [junit4]   2> 351814 INFO  (jetty-launcher-887-thread-1) [n:127.0.0.1:43927_solr    ] o.a.s.c.Overseer Overseer (id=72338987101454339-127.0.0.1:43927_solr-n_0000000000) starting
   [junit4]   2> 351822 INFO  (zkConnectionManagerCallback-905-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 351825 INFO  (jetty-launcher-887-thread-1) [n:127.0.0.1:43927_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43615/solr ready
   [junit4]   2> 351826 INFO  (OverseerStateUpdate-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [n:127.0.0.1:43927_solr    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:43927_solr
   [junit4]   2> 351826 INFO  (jetty-launcher-887-thread-1) [n:127.0.0.1:43927_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43927_solr
   [junit4]   2> 351827 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 351829 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 351829 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 351829 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 351835 INFO  (zkCallback-897-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 351839 INFO  (zkCallback-904-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 351841 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:43927_solr]
   [junit4]   2> 351841 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 351842 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 351842 DEBUG (ScheduledTrigger-1514-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 351851 INFO  (jetty-launcher-887-thread-1) [n:127.0.0.1:43927_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 351886 INFO  (jetty-launcher-887-thread-1) [n:127.0.0.1:43927_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43927.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@20d2084a
   [junit4]   2> 351913 INFO  (jetty-launcher-887-thread-1) [n:127.0.0.1:43927_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43927.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@20d2084a
   [junit4]   2> 351913 INFO  (jetty-launcher-887-thread-1) [n:127.0.0.1:43927_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43927.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@20d2084a
   [junit4]   2> 351914 INFO  (jetty-launcher-887-thread-1) [n:127.0.0.1:43927_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_A5AE538B01BD2CCC-001/tempDir-001/node1/.
   [junit4]   2> 351937 INFO  (zkConnectionManagerCallback-908-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 351941 INFO  (zkConnectionManagerCallback-913-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 351943 INFO  (SUITE-ScheduledMaintenanceTriggerTest-seed#[A5AE538B01BD2CCC]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 351944 INFO  (SUITE-ScheduledMaintenanceTriggerTest-seed#[A5AE538B01BD2CCC]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43615/solr ready
   [junit4]   2> 351962 INFO  (TEST-ScheduledMaintenanceTriggerTest.testInactiveShardCleanup-seed#[A5AE538B01BD2CCC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testInactiveShardCleanup
   [junit4]   2> 351964 INFO  (qtp325499065-3480) [n:127.0.0.1:43927_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&name=ScheduledMaintenanceTriggerTest_collection1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 351967 INFO  (OverseerThreadFactory-1516-thread-1-processing-n:127.0.0.1:43927_solr) [n:127.0.0.1:43927_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection ScheduledMaintenanceTriggerTest_collection1
   [junit4]   2> 352076 INFO  (qtp325499065-3475) [n:127.0.0.1:43927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 352082 INFO  (OverseerStateUpdate-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [n:127.0.0.1:43927_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"ScheduledMaintenanceTriggerTest_collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:43927/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 352286 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr    x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1&action=CREATE&numShards=1&collection=ScheduledMaintenanceTriggerTest_collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 352286 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr    x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 352844 DEBUG (ScheduledTrigger-1514-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 353303 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 353313 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.s.IndexSchema [ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 353317 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 353317 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1' using configuration from collection ScheduledMaintenanceTriggerTest_collection1, trusted=true
   [junit4]   2> 353319 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43927.solr.core.ScheduledMaintenanceTriggerTest_collection1.shard1.replica_n1' (registry 'solr.core.ScheduledMaintenanceTriggerTest_collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@20d2084a
   [junit4]   2> 353319 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.SolrCore [[ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_A5AE538B01BD2CCC-001/tempDir-001/node1/ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest_A5AE538B01BD2CCC-001/tempDir-001/node1/./ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1/data/]
   [junit4]   2> 353414 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 353414 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 353416 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 353416 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 353418 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7eedaa6d[ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] main]
   [junit4]   2> 353419 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 353420 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 353423 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 353423 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1618119425316093952
   [junit4]   2> 353425 INFO  (searcherExecutor-1521-thread-1-processing-n:127.0.0.1:43927_solr x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1 c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.SolrCore [ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] Registered new searcher Searcher@7eedaa6d[ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 353441 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/ScheduledMaintenanceTriggerTest_collection1/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 353446 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 353446 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 353446 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43927/solr/ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1/
   [junit4]   2> 353446 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 353447 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:43927/solr/ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1/ has no replicas
   [junit4]   2> 353451 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43927/solr/ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1/ shard1
   [junit4]   2> 353605 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 353608 INFO  (qtp325499065-3476) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1 r:core_node2 x:ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=ScheduledMaintenanceTriggerTest_collection1_shard1_replica_n1&action=CREATE&numShards=1&collection=ScheduledMaintenanceTriggerTest_collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1322
   [junit4]   2> 353612 INFO  (qtp325499065-3480) [n:127.0.0.1:43927_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 353708 INFO  (zkCallback-897-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/ScheduledMaintenanceTriggerTest_collection1/state.json] for collection [ScheduledMaintenanceTriggerTest_collection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 353844 DEBUG (ScheduledTrigger-1514-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 353969 INFO  (OverseerCollectionConfigSetProcessor-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [n:127.0.0.1:43927_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 354612 INFO  (qtp325499065-3480) [n:127.0.0.1:43927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&name=ScheduledMaintenanceTriggerTest_collection1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=2647
   [junit4]   2> 354635 INFO  (qtp325499065-3475) [n:127.0.0.1:43927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.ScheduledMaintenanceTriggerTest_collection1.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=2
   [junit4]   2> 354636 INFO  (qtp325499065-3481) [n:127.0.0.1:43927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 354637 DEBUG (qtp325499065-3479) [n:127.0.0.1:43927_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 354637 INFO  (qtp325499065-3479) [n:127.0.0.1:43927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=16
   [junit4]   2> 354639 DEBUG (zkCallback-904-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 354640 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 354641 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 354641 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 354643 INFO  (qtp325499065-3481) [n:127.0.0.1:43927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.ScheduledMaintenanceTriggerTest_collection1.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 354644 INFO  (qtp325499065-3478) [n:127.0.0.1:43927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 354645 DEBUG (qtp325499065-3482) [n:127.0.0.1:43927_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 354645 INFO  (qtp325499065-3482) [n:127.0.0.1:43927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=5
   [junit4]   2> 354646 DEBUG (zkCallback-904-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 354646 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 354646 INFO  (qtp325499065-3479) [n:127.0.0.1:43927_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :splitshard with params action=SPLITSHARD&collection=ScheduledMaintenanceTriggerTest_collection1&shard=shard1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 354649 DEBUG (ScheduledTrigger-1514-thread-3) [    ] o.a.s.c.a.ScheduledTrigger ScheduledTrigger .scheduled_maintenance firing registered processor for scheduled time 2018-11-25T15:15:37.208Z, now=2018-11-25T15:15:38.027Z
   [junit4]   2> 354649 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 354649 DEBUG (ScheduledTrigger-1514-thread-3) [    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
   [junit4]   2>   "source":".scheduled_maintenance",
   [junit4]   2>   "eventTime":4293720686521851,
   [junit4]   2>   "eventType":"SCHEDULED",
   [junit4]   2>   "properties":{"actualEventTime":1543158938027}}
   [junit4]   2> 354649 DEBUG (OverseerAutoScalingTriggerThread-72338987101454339-127.0.0.1:43927_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 354650 DEBUG (ScheduledTrigger-1514-thread-3) [    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, .scheduled_maintenance]
   [junit4]   2> 354651 INFO  (ScheduledTrigger-1514-thread-3) [    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 354652 INFO  (ScheduledTrigger-1514-thread-3) [    ] o.a.s.c.a.ScheduledMaintenanceTriggerTest =======> CapturedEvent{timestamp=4293720689473424, stage=STARTED, actionName='null', event={
   [junit4]   2>   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
   [junit4]   2>   "source":".scheduled_maintenance",
   [junit4]   2>   "eventTime":4293720686521851,
   [junit4]   2>   "eventType":"SCHEDULED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "actualEventTime":1543158938027,
   [junit4]   2>     "_enqueue_time_":4293720687554532}}, context={}, config={
   [junit4]   2>   "trigger":".scheduled_maintenance",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "beforeAction":"inactive_shard_plan",
   [junit4]   2>   "afterAction":"inactive_shard_plan",
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}
   [junit4]   2> 354652 DEBUG (AutoscalingActionExecutor-1515-thread-1) [    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
   [junit4]   2>   "source":".scheduled_maintenance",
   [junit4]   2>   "eventTime":4293720686521851,
   [junit4]   2>   "eventType":"SCHEDULED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "actualEventTime":1543158938027,
   [junit4]   2>     "_enqueue_time_":4293720687554532}}
   [junit4]   2> 354656 INFO  (qtp325499065-3478) [n:127.0.0.1:43927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 354657 INFO  (qtp325499065-3478) [n:127.0.0.1:43927_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.ScheduledMaintenanceTriggerTest_collection1.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
   [junit4]   2> 354660 INFO  (AutoscalingActionExecutor-1515-thread-1) [    ] o.a.s.c.a.ScheduledMaintenanceTriggerTest =======> CapturedEvent{timestamp=4293720696068396, stage=BEFORE_ACTION, actionName='inactive_shard_plan', event={
   [junit4]   2>   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
   [junit4]   2>   "source":".scheduled_maintenance",
   [junit4]   2>   "eventTime":4293720686521851,
   [junit4]   2>   "eventType":"SCHEDULED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "actualEventTime":1543158938027,
   [junit4]   2>     "_enqueue_time_":4293720687554532}}, context={properties.BEFORE_ACTION=[inactive_shard_plan], source=.scheduled_maintenance}, config={
   [junit4]   2>   "trigger":".scheduled_maintenance",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "beforeAction":"inactive_shard_plan",
   [junit4]   2>   "afterAction":"inactive_shard_plan",
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}
   [junit4]   2> 354662 INFO  (OverseerThreadFactory-1516-thread-2-processing-n:127.0.0.1:43927_solr) [n:127.0.0.1:43927_solr c:ScheduledMaintenanceTriggerTest_collection1 s:shard1  ] o.a.s.c.a.c.SplitShardCmd numSubShards set at: 2
   [junit4]   2> 354663 DEBUG (AutoscalingActionExecutor-1515-thread-1) [    ] o.a.s.c.a.InactiveShardPlanAction ScheduledMaintenanceTriggerTest_collection1/shard1-splitting: locktstamp=1543158938039221077, time=1543158938042668508, delta=0
   [junit4]   2> 354663 DEBUG (AutoscalingActionExecutor-1515-thread-1) [    ] o.a.s.c.a.InactiveShardPlanAction -- lock ScheduledMaintenanceTriggerTest_collection1/shard1-splitting still active (delta=0)
   [junit4]   2> 354664 DEBUG (AutoscalingActionExecutor-1515-thread-1) [    ] o.a.s.c.a.InactiveShardPlanAction ScheduledMaintenanceTriggerTest_collection1/staleShard-splitting: locktstamp=1542986137997200538, time=1543158938043149631, delta=172800
   [junit4]   2> 354664 DEBUG (AutoscalingActionExecutor-1515-thread-1) [    ] o.a.s.c.a.InactiveShardPlanAction -- delete inactive split lock for ScheduledMaintenanceTriggerTest_collection1/staleShard-splitting, delta=172800
   [junit4]   2> 354664 INFO  (AutoscalingActionExecutor-1515-thread-1) [    ] o.a.s.c.a.ScheduledMaintenanceTriggerTest =======> CapturedEvent{timestamp=4293720701970255, stage=AFTER_ACTION, actionName='inactive_shard_plan', event={
   [junit4]   2>   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
   [junit4]   2>   "source":".scheduled_maintenance",
   [junit4]   2>   "eventTime":4293720686521851,
   [junit4]   2>   "eventType":"SCHEDULED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "actualEventTime":1543158938027,
   [junit4]   2>     "_enqueue_time_":4293720687554532}}, context={properties.BEFORE_ACTION=[inactive_shard_plan], source=.scheduled_maintenance, properties.inactive_shard_plan={staleLocks={ScheduledMaintenanceTriggerTest_collection1/staleShard-splitting={stateTimestamp=1542986137997200538, currentTimeNs=1543158938043149631, deltaSec=172800, ttlSec=20}}}, properties.AFTER_ACTION=[inactive_shard_plan]}, config={
   [junit4]   2>   "trigger":".scheduled_maintenance",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "beforeAction":"inactive_shard_plan",
   [junit4]   2>   "afterAction":"inactive_shard_plan",
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}
   [junit4]   2> 354665 DEBUG (AutoscalingActionExecutor-1515-thread-1) [    ] o.a.s.c.a.ExecutePlanAction -- processing event: {
   [junit4]   2>   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
   [junit4]   2>   "source":".scheduled_maintenance",
   [junit4]   2>   "eventTime":4293720686521851,
   [junit4]   2>   "eventType":"SCHEDULED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "actualEventTime":1543158938027,
   [junit4]   2>     "_enqueue_time_":4293720687554532}} with context properties: {inactive_shard_plan={staleLocks={ScheduledMaintenanceTriggerTest_collection1/staleShard-splitting={stateTimestamp=1542986137997200538, currentTimeNs=1543158938043149631, deltaSec=172800, ttlSec=20}}}, AFTER_ACTION=[inactive_shard_plan], BEFORE_ACTION=[inactive_shard_plan, execute_plan]}
   [junit4]   2> 354665 INFO  (AutoscalingActionExecutor-1515-thread-1) [    ] o.a.s.c.a.ExecutePlanAction No operations to execute for event: {
   [junit4]   2>   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
   [junit4]   2>   "source":".scheduled_maintenance",
   [junit4]   2>   "eventTime":4293720686521851,
   [junit4]   2>   "eventType":"SCHEDULED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "actualEventTime":1543158938027,
   [junit4]   2>     "_enqueue_time_":4293720687554532}}
   [junit4]   2> 354666 INFO  (AutoscalingActionExecutor-1515-thread-1) [    ] o.a.s.c.a.ScheduledMaintenanceTriggerTest =======> CapturedEvent{timestamp=4293720703745443, stage=SUCCEEDED, actionName='null', event={
   [junit4]   2>   "id":"f411dc048edfbTcygsv8yw1dhe90l5lhirqx62f",
   [junit4]   2>   "source":".scheduled_maintenance",
   [junit4]   2>   "eventTime":4293720686521851,
   [junit4]   2>   "eventType":"SCHEDULED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "actualEventTime":1543158938027,
   [junit4]   2>     "_enqueue_time_":4293720687554532}}, context={}, config={
   [junit4]   2>   "trigger":".scheduled_maintenance",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "beforeAction":"inactive_shard_plan",
   [junit4]   2>   "afterAction":"inactive_shard_plan",
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.ScheduledMaintenanceTriggerTest$CapturingTriggerListener"}, message='null'}
   [junit4]   2> 354666 DEBUG (AutoscalingActionExecutor-1515-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 354666 DEBUG (AutoscalingActionExecutor-1515-thread

[...truncated too long message...]

kins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null849123445
     [copy] Copying 240 files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null849123445
   [delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null849123445

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 55ms :: artifacts dl 6ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
        ---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 117 minutes 37 seconds
Archiving artifacts
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$34.hasMatch(FilePath.java:2678)
        at hudson.FilePath$34.invoke(FilePath.java:2557)
        at hudson.FilePath$34.invoke(FilePath.java:2547)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2918)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to lucene
                at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:955)
                at hudson.FilePath.act(FilePath.java:1036)
                at hudson.FilePath.act(FilePath.java:1025)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
                at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1819)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2920)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath.act(FilePath.java:1038)
        at hudson.FilePath.act(FilePath.java:1025)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1819)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-BadApples-Tests-master - Build # 220 - Still Unstable

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-BadApples-Tests-master/220/

6 tests failed.
FAILED:  org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test

Error Message:
Didn't see replicas [core_node4, core_node5] come up within 90000 ms! ClusterState: DocCollection(c8n_1x3_lf//collections/c8n_1x3_lf/state.json/13)={   "pullReplicas":"0",   "replicationFactor":"3",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node4":{           "core":"c8n_1x3_lf_shard1_replica_n1",           "base_url":"http://127.0.0.1:38925",           "node_name":"127.0.0.1:38925_",           "state":"recovering",           "type":"NRT"},         "core_node5":{           "core":"c8n_1x3_lf_shard1_replica_n2",           "base_url":"http://127.0.0.1:42670",           "node_name":"127.0.0.1:42670_",           "state":"active",           "type":"NRT",           "leader":"true"},         "core_node6":{           "core":"c8n_1x3_lf_shard1_replica_n3",           "base_url":"http://127.0.0.1:43356",           "node_name":"127.0.0.1:43356_",           "state":"down",           "type":"NRT"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"1",   "autoAddReplicas":"false",   "nrtReplicas":"3",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Didn't see replicas [core_node4, core_node5] come up within 90000 ms! ClusterState: DocCollection(c8n_1x3_lf//collections/c8n_1x3_lf/state.json/13)={
  "pullReplicas":"0",
  "replicationFactor":"3",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node4":{
          "core":"c8n_1x3_lf_shard1_replica_n1",
          "base_url":"http://127.0.0.1:38925",
          "node_name":"127.0.0.1:38925_",
          "state":"recovering",
          "type":"NRT"},
        "core_node5":{
          "core":"c8n_1x3_lf_shard1_replica_n2",
          "base_url":"http://127.0.0.1:42670",
          "node_name":"127.0.0.1:42670_",
          "state":"active",
          "type":"NRT",
          "leader":"true"},
        "core_node6":{
          "core":"c8n_1x3_lf_shard1_replica_n3",
          "base_url":"http://127.0.0.1:43356",
          "node_name":"127.0.0.1:43356_",
          "state":"down",
          "type":"NRT"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false",
  "nrtReplicas":"3",
  "tlogReplicas":"0"}
        at __randomizedtesting.SeedInfo.seed([1F94773EA3E48126:97C048E40D18ECDE]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.HttpPartitionTest.waitToSeeReplicasActive(HttpPartitionTest.java:611)
        at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:183)
        at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:57)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.ShardRoutingTest.test

Error Message:
Error from server at <a href="http://127.0.0.1:36892:">http://127.0.0.1:36892: At least one of the node(s) specified [127.0.0.1:33087_] are not currently active in [], no action taken.

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at <a href="http://127.0.0.1:36892:">http://127.0.0.1:36892: At least one of the node(s) specified [127.0.0.1:33087_] are not currently active in [], no action taken.
        at __randomizedtesting.SeedInfo.seed([1F94773EA3E48126:97C048E40D18ECDE]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1107)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:425)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:341)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1008)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ShardRoutingTest

Error Message:
155 threads leaked from SUITE scope at org.apache.solr.cloud.ShardRoutingTest:     1) Thread[id=11152, name=zkConnectionManagerCallback-2887-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=11393, name=SolrRrdBackendFactory-4174-thread-2, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    3) Thread[id=11339, name=zkConnectionManagerCallback-2894-thread-1-EventThread, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)    4) Thread[id=11095, name=qtp1993691116-11095, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)    5) Thread[id=11237, name=Scheduler-1295925267, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    6) Thread[id=11215, name=Scheduler-1946070101, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    7) Thread[id=11159, name=MetricsHistoryHandler-4175-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    8) Thread[id=11325, name=TEST-ShardRoutingTest.test-seed#[1F94773EA3E48126]-EventThread, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)    9) Thread[id=11220, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   10) Thread[id=11144, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   11) Thread[id=11113, name=TEST-ShardRoutingTest.test-seed#[1F94773EA3E48126]-EventThread, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   12) Thread[id=11316, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   13) Thread[id=11198, name=Thread-2897, state=WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:502)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1857)   14) Thread[id=11235, name=Thread-2906, state=WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:502)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1857)   15) Thread[id=11357, name=OverseerStateUpdate-73733525038825482-127.0.0.1:41481_-n_0000000001, state=TIMED_WAITING, group=Overseer state updater.]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)         at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)         at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:341)         at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:421)         at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:147)         at java.lang.Thread.run(Thread.java:748)   16) Thread[id=11315, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   17) Thread[id=11349, name=zkConnectionManagerCallback-2926-thread-1-EventThread, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   18) Thread[id=11396, name=SolrRrdBackendFactory-4216-thread-2, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   19) Thread[id=11226, name=TEST-ShardRoutingTest.test-seed#[1F94773EA3E48126]-EventThread, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   20) Thread[id=11150, name=TEST-ShardRoutingTest.test-seed#[1F94773EA3E48126]-SendThread(127.0.0.1:35148), state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)   21) Thread[id=11102, name=Scheduler-1220022993, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   22) Thread[id=11099, name=qtp1993691116-11099, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   23) Thread[id=11219, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   24) Thread[id=11160, name=Thread-2888, state=WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:502)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1857)   25) Thread[id=11327, name=SolrRrdBackendFactory-4230-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   26) Thread[id=11251, name=qtp762532995-11251, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   27) Thread[id=11184, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   28) Thread[id=11276, name=searcherExecutor-4219-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   29) Thread[id=11326, name=zkConnectionManagerCallback-2959-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   30) Thread[id=11348, name=zkConnectionManagerCallback-2926-thread-1-SendThread(127.0.0.1:35148), state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)   31) Thread[id=11212, name=qtp160614903-11212, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   32) Thread[id=11359, name=OverseerAutoScalingTriggerThread-73733525038825482-127.0.0.1:41481_-n_0000000001, state=WAITING, group=Overseer autoscaling triggers]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:189)         at java.lang.Thread.run(Thread.java:748)   33) Thread[id=11195, name=zkConnectionManagerCallback-2910-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   34) Thread[id=11324, name=TEST-ShardRoutingTest.test-seed#[1F94773EA3E48126]-SendThread(127.0.0.1:35148), state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)   35) Thread[id=11145, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   36) Thread[id=11213, name=qtp160614903-11213, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   37) Thread[id=11363, name=ScheduledTrigger-4236-thread-4, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   38) Thread[id=11208, name=qtp160614903-11208, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   39) Thread[id=11362, name=ScheduledTrigger-4236-thread-3, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)         at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)         at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:317)         at org.apache.solr.client.solrj.impl.ZkDistribStateManager.hasData(ZkDistribStateManager.java:58)         at org.apache.solr.cloud.autoscaling.TriggerBase.saveState(TriggerBase.java:234)         at org.apache.solr.cloud.autoscaling.ScheduledTriggers$TriggerWrapper.run(ScheduledTriggers.java:598)         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   40) Thread[id=11263, name=TEST-ShardRoutingTest.test-seed#[1F94773EA3E48126]-EventThread, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   41) Thread[id=11227, name=zkConnectionManagerCallback-2919-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   42) Thread[id=11162, name=Scheduler-1047472598, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   43) Thread[id=11183, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   44) Thread[id=11196, name=SolrRrdBackendFactory-4188-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   45) Thread[id=11188, name=TEST-ShardRoutingTest.test-seed#[1F94773EA3E48126]-SendThread(127.0.0.1:35148), state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)   46) Thread[id=11239, name=searcherExecutor-4205-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   47) Thread[id=11249, name=qtp762532995-11249, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   48) Thread[id=11293, name=qtp53441196-11293, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   49) Thread[id=11353, name=zkConnectionManagerCallback-2910-thread-1-EventThread, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   50) Thread[id=11128, name=searcherExecutor-4163-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   51) Thread[id=11178, name=Scheduler-1359750758, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   52) Thread[id=11112, name=TEST-ShardRoutingTest.test-seed#[1F94773EA3E48126]-SendThread(127.0.0.1:35148), state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)   53) Thread[id=11101, name=qtp1993691116-11101, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   54) Thread[id=11233, name=SolrRrdBackendFactory-4202-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   55) Thread[id=11329, name=Thread-2924, state=WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:502)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1857)   56) Thread[id=11332, name=zkConnectionManagerCallback-2878-thread-1-SendThread(127.0.0.1:35148), state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)   57) Thread[id=11170, name=qtp525198299-11170, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   58) Thread[id=11209, name=qtp160614903-11209-acceptor-0@2647a10e-ServerConnector@22e2a39b{HTTP/1.1,[http/1.1]}{127.0.0.1:43039}, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)         at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   59) Thread[id=11344, name=zkConnectionManagerCallback-2942-thread-1-SendThread(127.0.0.1:35148), state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)   60) Thread[id=11134, name=qtp751587891-11134-acceptor-0@7758c6c3-ServerConnector@2957d3db{HTTP/1.1,[http/1.1]}{127.0.0.1:36892}, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)         at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   61) Thread[id=11257, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   62) Thread[id=11333, name=zkConnectionManagerCallback-2878-thread-1-EventThread, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   63) Thread[id=11133, name=qtp751587891-11133, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   64) Thread[id=11140, name=Scheduler-1045413967, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   65) Thread[id=11288, name=qtp53441196-11288, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at org.eclipse.jetty.io.ManagedSelector$$Lambda$33/2063673012.run(Unknown Source)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   66) Thread[id=11247, name=qtp762532995-11247, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   67) Thread[id=11392, name=SolrRrdBackendFactory-4160-thread-2, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   68) Thread[id=11321, name=TEST-ShardRoutingTest.test-seed#[1F94773EA3E48126]-EventThread, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   69) Thread[id=11189, name=TEST-ShardRoutingTest.test-seed#[1F94773EA3E48126]-EventThread, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)   70) Thread[id=11398, name=SolrRrdBackendFactory-4230-thread-2, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   71) Thread[id=11107, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   72) Thread[id=11211, name=qtp160614903-11211, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   73) Thread[id=11271, name=MetricsHistoryHandler-4217-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   74) Thread[id=11157, name=zkConnectionManagerCallback-2894-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   75) Thread[id=11173, name=qtp525198299-11173, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   76) Thread[id=11290, name=qtp53441196-11290, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   77) Thread[id=11122, name=MetricsHistoryHandler-4161-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   78) Thread[id=11206, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   79) Thread[id=11269, name=zkConnectionManagerCallback-2942-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   80) Thread[id=11394, name=SolrRrdBackendFactory-4188-thread-2, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   81) Thread[id=11169, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   82) Thread[id=11322, name=zkConnectionManagerCallback-2952-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   83) Thread[id=11289, name=qtp53441196-11289, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   84) Thread[id=11320, name=TEST-ShardRoutingTest.test-seed#[1F94773EA3E48126]-SendThread(127.0.0.1:35148), state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1054)   85) Thread[id=11252, name=Scheduler-742153395, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   86) Thread[id=11256, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   87) Thread[id=11395, name=SolrRrdBackendFactory-4202-thread-2, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   88) Thread[id=11106, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   89) Thread[id=11135, name=qtp751587891-11135, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:292)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:357)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   90) Thread[id=11397, name=AutoscalingActionExecutor-4237-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)         at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)         at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:341)         at org.apache.solr.client.solrj.impl.ZkDistribStateManager.getAutoScalingConfig(ZkDistribStateManager.java:176)         at org.apache.solr.client.solrj.cloud.DistribStateManager.getAutoScalingConfig(DistribStateManager.java:83)         at org.apache.solr.cloud.autoscaling.ComputePlanAction.process(ComputePlanAction.java:85)         at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$3(ScheduledTriggers.java:308)         at org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$742/657634462.run(Unknown Source)         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)         at java.util.concurrent.FutureTask.run(FutureTask.java:266)         at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)         at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$10/1783238997.run(Unknown Source)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   91) Thread[id=11272, name=Thread-2915, state=WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:502)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1857)   92) Thread[id=11174, name=qtp525198299-11174, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   93) Thread[id=11203, name=searcherExecutor-4191-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   94) Thread[id=11120, name=zkConnectionManagerCallback-2878-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   95) Thread[id=11244, name=qtp762532995-11244, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   96) Thread[id=11138, name=qtp751587891-11138, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   97) Thread[id=11176, name=qtp525198299-11176, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   98) Thread[id=11182, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   99) Thread[id=11207, name=qtp160614903-11207, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:653)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:717)         at java.lang.Thread.run(Thread.java:748)   100) Thread[id=11214, name=qtp160614903-11214, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   101) Thread[id=11281, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   102) Thread[id=11146, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   103) Thread[id=11264, name=zkConnectionManagerCallback-2935-thread-1, state=WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   104) Thread[id=11248, name=qtp762532995-11248, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   105) Thread[id=11175, name=qtp525198299-11175, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:396)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:333)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   106) Thread[id=11258, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)   107) Thread[id=11096, name=qtp1993691116-11096-acceptor-0@7836dceb-ServerConnector@2d071b70{HTTP/1.1,[http/1.1]}{127.0.0.1:41481}, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)         at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   108) Thread[id=11246, name=qtp762532995-11246-acceptor-0@43d2e5e3-ServerConnector@28e9cc62{HTTP/1.1,[http/1.1]}{127.0.0.1:43509}, state=RUNNABLE, group=TGRP-ShardRoutingTest]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)         at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:369)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:639)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:762)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:680)         at java.lang.Thread.run(Thread.java:748)   109) Thread[id=11201, name=Scheduler-1321028896, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)   110) Thread[id=11131, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]         at java.lang.T

[...truncated too long message...]

BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null423358163
     [copy] Copying 240 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null423358163
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null423358163

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 33ms :: artifacts dl 5ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
        ---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 176 minutes 34 seconds
Archiving artifacts
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$34.hasMatch(FilePath.java:2678)
        at hudson.FilePath$34.invoke(FilePath.java:2557)
        at hudson.FilePath$34.invoke(FilePath.java:2547)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2918)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to lucene2
                at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:955)
                at hudson.FilePath.act(FilePath.java:1036)
                at hudson.FilePath.act(FilePath.java:1025)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
                at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1819)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2920)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath.act(FilePath.java:1038)
        at hudson.FilePath.act(FilePath.java:1025)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1819)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-BadApples-Tests-master - Build # 221 - Still Unstable

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-BadApples-Tests-master/221/

2 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
max version bucket seed not updated after recovery!

Stack Trace:
java.lang.AssertionError: max version bucket seed not updated after recovery!
        at __randomizedtesting.SeedInfo.seed([CC0F0D81016CFDF1:445B325BAF909009]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.apache.solr.cloud.HttpPartitionTest.testRf2(HttpPartitionTest.java:290)
        at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:131)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMaxOps

Error Message:
number of ops: [Op{action=SPLITSHARD, hints={COLL_SHARD=[{   "first":"testMaxOps_collection",   "second":"shard5"}], PARAMS={splitMethod=rewrite}}}, Op{action=SPLITSHARD, hints={COLL_SHARD=[{   "first":"testMaxOps_collection",   "second":"shard4"}], PARAMS={splitMethod=rewrite}}}, Op{action=SPLITSHARD, hints={COLL_SHARD=[{   "first":"testMaxOps_collection",   "second":"shard2"}], PARAMS={splitMethod=rewrite}}}, Op{action=SPLITSHARD, hints={COLL_SHARD=[{   "first":"testMaxOps_collection",   "second":"shard1"}], PARAMS={splitMethod=rewrite}}}, Op{action=SPLITSHARD, hints={COLL_SHARD=[{   "first":"testMaxOps_collection",   "second":"shard3"}], PARAMS={splitMethod=rewrite}}}, Op{action=SPLITSHARD, hints={COLL_SHARD=[{   "first":".system",   "second":"shard1"}], PARAMS={splitMethod=rewrite}}}] expected:<5> but was:<6>

Stack Trace:
java.lang.AssertionError: number of ops: [Op{action=SPLITSHARD, hints={COLL_SHARD=[{
  "first":"testMaxOps_collection",
  "second":"shard5"}], PARAMS={splitMethod=rewrite}}}, Op{action=SPLITSHARD, hints={COLL_SHARD=[{
  "first":"testMaxOps_collection",
  "second":"shard4"}], PARAMS={splitMethod=rewrite}}}, Op{action=SPLITSHARD, hints={COLL_SHARD=[{
  "first":"testMaxOps_collection",
  "second":"shard2"}], PARAMS={splitMethod=rewrite}}}, Op{action=SPLITSHARD, hints={COLL_SHARD=[{
  "first":"testMaxOps_collection",
  "second":"shard1"}], PARAMS={splitMethod=rewrite}}}, Op{action=SPLITSHARD, hints={COLL_SHARD=[{
  "first":"testMaxOps_collection",
  "second":"shard3"}], PARAMS={splitMethod=rewrite}}}, Op{action=SPLITSHARD, hints={COLL_SHARD=[{
  "first":".system",
  "second":"shard1"}], PARAMS={splitMethod=rewrite}}}] expected:<5> but was:<6>
        at __randomizedtesting.SeedInfo.seed([CC0F0D81016CFDF1:2DF040E44FC9C004]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMaxOps(IndexSizeTriggerTest.java:783)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12997 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_CC0F0D81016CFDF1-001/init-core-data-001
   [junit4]   2> 1043533 WARN  (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 1043567 INFO  (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1043568 INFO  (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1043569 INFO  (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1043569 INFO  (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_CC0F0D81016CFDF1-001/tempDir-001
   [junit4]   2> 1043570 INFO  (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1043600 INFO  (Thread-846) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1043600 INFO  (Thread-846) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1043637 ERROR (Thread-846) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1043697 INFO  (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:45609
   [junit4]   2> 1043766 INFO  (zkConnectionManagerCallback-1512-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1043873 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 1043881 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 1043944 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1043944 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1043944 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1043945 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6855b999{/solr,null,AVAILABLE}
   [junit4]   2> 1043945 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@60828997{SSL,[ssl, http/1.1]}{127.0.0.1:35291}
   [junit4]   2> 1043945 INFO  (jetty-launcher-1509-thread-2) [    ] o.e.j.s.Server Started @1043986ms
   [junit4]   2> 1043945 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35291}
   [junit4]   2> 1043946 ERROR (jetty-launcher-1509-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1043946 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1043954 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1043954 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1043955 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1043955 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@365a0939{/solr,null,AVAILABLE}
   [junit4]   2> 1043964 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1043964 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1043964 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1043964 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-11-27T10:33:25.592Z
   [junit4]   2> 1044032 INFO  (zkConnectionManagerCallback-1514-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1044066 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@645be4bd{SSL,[ssl, http/1.1]}{127.0.0.1:35292}
   [junit4]   2> 1044066 INFO  (jetty-launcher-1509-thread-1) [    ] o.e.j.s.Server Started @1044107ms
   [junit4]   2> 1044066 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35292}
   [junit4]   2> 1044067 ERROR (jetty-launcher-1509-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1044067 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1044067 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1044067 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1044067 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1044067 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-11-27T10:33:25.695Z
   [junit4]   2> 1044103 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1044284 INFO  (zkConnectionManagerCallback-1516-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1044285 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1045120 INFO  (jetty-launcher-1509-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45609/solr
   [junit4]   2> 1045122 INFO  (jetty-launcher-1509-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45609/solr
   [junit4]   2> 1045171 INFO  (zkConnectionManagerCallback-1520-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1045192 INFO  (zkConnectionManagerCallback-1524-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1045233 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x105f8fd9a560004, likely client has closed socket
   [junit4]   2> 1045297 INFO  (zkConnectionManagerCallback-1526-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1045317 INFO  (zkConnectionManagerCallback-1528-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1045780 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:35292_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35292_solr
   [junit4]   2> 1045781 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:35292_solr    ] o.a.s.c.Overseer Overseer (id=73738737021222917-127.0.0.1:35292_solr-n_0000000000) starting
   [junit4]   2> 1045908 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:35291_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35291_solr
   [junit4]   2> 1045921 INFO  (zkConnectionManagerCallback-1537-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1045923 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:35292_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1045924 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:35292_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45609/solr ready
   [junit4]   2> 1045942 INFO  (OverseerStateUpdate-73738737021222917-127.0.0.1:35292_solr-n_0000000000) [n:127.0.0.1:35292_solr    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:35292_solr
   [junit4]   2> 1045959 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:35292_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1045959 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:35292_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35292_solr
   [junit4]   2> 1046079 INFO  (zkCallback-1525-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1046079 INFO  (zkCallback-1527-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1046079 INFO  (OverseerStateUpdate-73738737021222917-127.0.0.1:35292_solr-n_0000000000) [n:127.0.0.1:35292_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1046104 DEBUG (OverseerAutoScalingTriggerThread-73738737021222917-127.0.0.1:35292_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 1046136 INFO  (zkCallback-1536-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1046140 DEBUG (OverseerAutoScalingTriggerThread-73738737021222917-127.0.0.1:35292_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 1046140 DEBUG (OverseerAutoScalingTriggerThread-73738737021222917-127.0.0.1:35292_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 1046140 DEBUG (OverseerAutoScalingTriggerThread-73738737021222917-127.0.0.1:35292_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 1046152 INFO  (zkCallback-1527-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1046154 INFO  (zkConnectionManagerCallback-1542-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1046156 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:35291_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1046174 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:35291_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45609/solr ready
   [junit4]   2> 1046177 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:35292_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1046207 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:35291_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1046578 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:35292_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35292.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bada17f
   [junit4]   2> 1046579 DEBUG (OverseerAutoScalingTriggerThread-73738737021222917-127.0.0.1:35292_solr-n_0000000000) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:35292_solr, 127.0.0.1:35291_solr]
   [junit4]   2> 1046580 DEBUG (ScheduledTrigger-1609-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1046591 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:35291_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35291.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bada17f
   [junit4]   2> 1046593 DEBUG (OverseerAutoScalingTriggerThread-73738737021222917-127.0.0.1:35292_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1046664 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:35291_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35291.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bada17f
   [junit4]   2> 1046664 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:35291_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35291.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bada17f
   [junit4]   2> 1046665 INFO  (jetty-launcher-1509-thread-2) [n:127.0.0.1:35291_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_CC0F0D81016CFDF1-001/tempDir-001/node2/.
   [junit4]   2> 1046670 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:35292_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35292.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bada17f
   [junit4]   2> 1046670 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:35292_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35292.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bada17f
   [junit4]   2> 1046692 INFO  (jetty-launcher-1509-thread-1) [n:127.0.0.1:35292_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_CC0F0D81016CFDF1-001/tempDir-001/node1/.
   [junit4]   2> 1046723 DEBUG (OverseerAutoScalingTriggerThread-73738737021222917-127.0.0.1:35292_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 1047145 INFO  (zkConnectionManagerCallback-1546-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1047193 INFO  (zkConnectionManagerCallback-1551-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1047250 INFO  (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1047323 INFO  (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45609/solr ready
   [junit4]   2> 1047542 DEBUG (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10001_solr
   [junit4]   2> 1047542 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 1047542 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
   [junit4]   2> 1047543 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
   [junit4]   2> 1047543 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
   [junit4]   2> 1047610 DEBUG (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=0
   [junit4]   2> 1047610 DEBUG (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 1047610 INFO  (SUITE-IndexSizeTriggerTest-seed#[CC0F0D81016CFDF1]-worker) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1047667 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10002_solr]
   [junit4]   2> 1047683 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1047683 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
   [junit4]   2> 1047943 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1047975 DEBUG (ScheduledTrigger-1609-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048121 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048194 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048250 DEBUG (ScheduledTrigger-1622-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048303 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048340 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048376 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048413 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048433 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048436 INFO  (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSplitMethodConfig
   [junit4]   2> 1048469 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048486 DEBUG (simCloudManagerPool-1621-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testSplitMethod_collection, currentVersion=1
   [junit4]   2> 1048486 DEBUG (simCloudManagerPool-1621-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=1
   [junit4]   2> 1048486 DEBUG (simCloudManagerPool-1621-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 1048506 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048506 DEBUG (simCloudManagerPool-1621-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=2
   [junit4]   2> 1048506 DEBUG (simCloudManagerPool-1621-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 1048542 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048542 DEBUG (simCloudManagerPool-1621-thread-2) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=3
   [junit4]   2> 1048543 DEBUG (simCloudManagerPool-1621-thread-2) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 1048563 DEBUG (simCloudManagerPool-1621-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testSplitMethod_collection, currentVersion=4
   [junit4]   2> 1048579 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048676 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048692 DEBUG (simCloudManagerPool-1621-thread-5) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitMethod_collection / shard1 (currentVersion=4): {"core_node1":{
   [junit4]   2>     "core":"testSplitMethod_collection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testSplitMethod_collection",
   [junit4]   2>     "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1048692 DEBUG (simCloudManagerPool-1621-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=4
   [junit4]   2> 1048693 DEBUG (simCloudManagerPool-1621-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 1048712 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048720 DEBUG (simCloudManagerPool-1621-thread-4) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=5
   [junit4]   2> 1048814 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048815 DEBUG (simCloudManagerPool-1621-thread-4) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 1048842 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1048862 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=6
   [junit4]   2> 1049041 DEBUG (simCloudManagerPool-1621-thread-7) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitMethod_collection / shard2 (currentVersion=6): {"core_node3":{
   [junit4]   2>     "core":"testSplitMethod_collection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testSplitMethod_collection",
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1049045 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 1049053 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049053 DEBUG (ScheduledTrigger-1609-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049061 DEBUG (simCloudManagerPool-1621-thread-6) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=7
   [junit4]   2> 1049061 DEBUG (simCloudManagerPool-1621-thread-6) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 1049061 DEBUG (MetricsHistoryHandler-1625-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=8
   [junit4]   2> 1049179 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049199 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049227 DEBUG (MetricsHistoryHandler-1625-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 1049235 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049243 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=9
   [junit4]   2> 1049243 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 1049271 DEBUG (ScheduledTrigger-1622-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049324 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049362 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049382 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049417 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049454 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049490 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049527 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049563 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049600 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049636 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049673 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049709 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049746 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049782 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049818 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049855 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049887 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049908 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049924 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=10
   [junit4]   2> 1049924 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 1049944 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1049981 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1050017 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1050054 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1050054 DEBUG (ScheduledTrigger-1609-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1050090 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1050126 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1050145 INFO  (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.IndexSizeTriggerTest #######################################
   [junit4]   2> ############ CLUSTER STATE ############
   [junit4]   2> #######################################
   [junit4]   2> ## Live nodes: 2
   [junit4]   2> ## Empty nodes: 0
   [junit4]   2> ## Dead nodes: 0
   [junit4]   2> ## Collections:
   [junit4]   2> ##  * testSplitMethod_collection
   [junit4]   2> ##    shardsTotal 2
   [junit4]   2> ##    shardsState {active=2}
   [junit4]   2> ##      shardsWithoutLeader 0
   [junit4]   2> ##    totalReplicas 4
   [junit4]   2> ##      activeReplicas 4
   [junit4]   2> ##      inactiveReplicas 0
   [junit4]   2> ##    totalActiveDocs 25
   [junit4]   2> ##      bufferedDocs 0
   [junit4]   2> ##      maxActiveSliceDocs 14
   [junit4]   2> ##      minActiveSliceDocs 11
   [junit4]   2> ##      avgActiveSliceDocs 13
   [junit4]   2> ##    totalInactiveDocs 0
   [junit4]   2> ##      maxInactiveSliceDocs 0
   [junit4]   2> ##      minInactiveSliceDocs 0
   [junit4]   2> ##      avgInactiveSliceDocs NaN
   [junit4]   2> ##    totalActiveBytes 32,980
   [junit4]   2> ##      maxActiveSliceBytes 17,240
   [junit4]   2> ##      minActiveSliceBytes 15,740
   [junit4]   2> ##      avgActiveSliceBytes 16,490
   [junit4]   2> ##    totalInactiveBytes 0
   [junit4]   2> ##      maxInactiveSliceBytes 0
   [junit4]   2> ##      minInactiveSliceBytes 0
   [junit4]   2> ##      avgInactiveSliceBytes NaN
   [junit4]   2> ##    totalActiveDeletedDocs 0
   [junit4]   2> DocCollection(testSplitMethod_collection//clusterstate.json/10)={
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"2",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard2":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testSplitMethod_collection_shard2_replica_n3",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":11,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":15740,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":1.4659017324447632E-5,
   [junit4]   2>           "SEARCHER.searcher.numDocs":11},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testSplitMethod_collection_shard2_replica_n4",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":11,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":15740,
   [junit4]   2>           "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":1.4659017324447632E-5,
   [junit4]   2>           "SEARCHER.searcher.numDocs":11}},
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active"},
   [junit4]   2>     "shard1":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           "core":"testSplitMethod_collection_shard1_replica_n1",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":14,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":17240,
   [junit4]   2>           "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":1.605600118637085E-5,
   [junit4]   2>           "SEARCHER.searcher.numDocs":14},
   [junit4]   2>         "core_node2":{
   [junit4]   2>           "core":"testSplitMethod_collection_shard1_replica_n2",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":14,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":17240,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":1.605600118637085E-5,
   [junit4]   2>           "SEARCHER.searcher.numDocs":14}},
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"active"}}}
   [junit4]   2> ## Max replicas per node: 2
   [junit4]   2> ## Min replicas per node: 2
   [junit4]   2> ## Total replicas: 4
   [junit4]   2> ## * testSplitMethod_collection 4
   [junit4]   2> ## - active           4
   [junit4]   2> ######### Solr op counts ##########
   [junit4]   2> ## - CREATE             1
   [junit4]   2> ## - update            26
   [junit4]   2> ######### Autoscaling event counts ###########
   [junit4]   2>
   [junit4]   2> 1050146 INFO  (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
   [junit4]   2> 1050146 WARN  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Interrupted
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) ~[?:1.8.0_191]
   [junit4]   2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) ~[?:1.8.0_191]
   [junit4]   2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:189) [java/:?]
   [junit4]   2> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]
   [junit4]   2> 1050165 DEBUG (ScheduledTrigger-1622-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1050166 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 1050166 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 1050167 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 1050167 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
   [junit4]   2> 1050167 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 1050179 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 1050204 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
   [junit4]   2> 1050204 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
   [junit4]   2> 1050204 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
   [junit4]   2> 1050220 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10002_solr]
   [junit4]   2> 1050220 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1050220 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
   [junit4]   2> 1050220 DEBUG (ScheduledTrigger-1627-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1050224 DEBUG (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 1050241 DEBUG (ScheduledTrigger-1627-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1050261 DEBUG (ScheduledTrigger-1627-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1050276 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 1050290 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1050290 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1050290 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 1050378 INFO  (TEST-IndexSizeTriggerTest.testSplitMethodConfig-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testSplitMethodConfig
   [junit4]   2> 1050439 DEBUG (MetricsHistoryHandler-1625-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=11
   [junit4]   2> 1050439 DEBUG (MetricsHistoryHandler-1625-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 1050538 INFO  (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMergeIntegration
   [junit4]   2> 1050552 DEBUG (simCloudManagerPool-1626-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testMergeIntegration_collection, currentVersion=12
   [junit4]   2> 1050552 DEBUG (simCloudManagerPool-1626-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=12
   [junit4]   2> 1050552 DEBUG (simCloudManagerPool-1626-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 12
   [junit4]   2> 1050568 DEBUG (simCloudManagerPool-1626-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=13
   [junit4]   2> 1050568 DEBUG (simCloudManagerPool-1626-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 13
   [junit4]   2> 1050588 DEBUG (simCloudManagerPool-1626-thread-2) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=14
   [junit4]   2> 1050589 DEBUG (simCloudManagerPool-1626-thread-2) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 14
   [junit4]   2> 1050609 DEBUG (simCloudManagerPool-1626-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testMergeIntegration_collection, currentVersion=15
   [junit4]   2> 1050621 DEBUG (simCloudManagerPool-1626-thread-4) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard1 (currentVersion=15): {"core_node1":{
   [junit4]   2>     "core":"testMergeIntegration_collection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testMergeIntegration_collection",
   [junit4]   2>     "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1050625 DEBUG (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=15
   [junit4]   2> 1050625 DEBUG (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 15
   [junit4]   2> 1050641 DEBUG (simCloudManagerPool-1626-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=16
   [junit4]   2> 1050641 DEBUG (simCloudManagerPool-1626-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 16
   [junit4]   2> 1050665 DEBUG (simCloudManagerPool-1626-thread-5) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=17
   [junit4]   2> 1050666 DEBUG (simCloudManagerPool-1626-thread-5) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 17
   [junit4]   2> 1050666 DEBUG (simCloudManagerPool-1626-thread-7) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard2 (currentVersion=18): {"core_node3":{
   [junit4]   2>     "core":"testMergeIntegration_collection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testMergeIntegration_collection",
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1050681 DEBUG (simCloudManagerPool-1626-thread-6) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=18
   [junit4]   2> 1050682 DEBUG (simCloudManagerPool-1626-thread-6) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 18
   [junit4]   2> 1050682 DEBUG (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=19
   [junit4]   2> 1050682 DEBUG (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 19
   [junit4]   2> 1050759 DEBUG (simCloudManagerPool-1626-thread-29) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1050759 DEBUG (simCloudManagerPool-1626-thread-29) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 1050760 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 1050760 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1050760 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1050760 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 1050761 DEBUG (simCloudManagerPool-1626-thread-30) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1050762 DEBUG (simCloudManagerPool-1626-thread-30) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 1050762 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 1050762 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1050762 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1050762 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 1050771 DEBUG (simCloudManagerPool-1626-thread-31) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1050771 DEBUG (simCloudManagerPool-1626-thread-31) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 1050771 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 1050772 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1050772 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1050772 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 1050826 DEBUG (simCloudManagerPool-1626-thread-48) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 1050826 DEBUG (simCloudManagerPool-1626-thread-48) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 1050835 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 1050836 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 1050836 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 1050836 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 1050931 DEBUG (ScheduledTrigger-1627-thread-4) [    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5",
   [junit4]   2>   "source":"index_size_trigger3",
   [junit4]   2>   "eventTime":25663587459251701,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "aboveSize":{},
   [junit4]   2>     "belowSize":{
   [junit4]   2>       "testMergeIntegration_collection_shard1_replica_n1":"docs=2, bytes=11240",
   [junit4]   2>       "testMergeIntegration_collection_shard2_replica_n3":"docs=3, bytes=11740"},
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"MERGESHARDS",
   [junit4]   2>         "hints":{"COLL_SHARD":[
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard1"},
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard2"}]}}]}}
   [junit4]   2> 1050937 DEBUG (ScheduledTrigger-1627-thread-4) [    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger3]
   [junit4]   2> 1050939 DEBUG (simCloudManagerPool-1626-thread-49) [    ] o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection .system, currentVersion=20
   [junit4]   2> 1050939 DEBUG (simCloudManagerPool-1626-thread-49) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=20
   [junit4]   2> 1050953 DEBUG (simCloudManagerPool-1626-thread-49) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 20
   [junit4]   2> 1050973 DEBUG (simCloudManagerPool-1626-thread-49) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=21
   [junit4]   2> 1050974 DEBUG (simCloudManagerPool-1626-thread-49) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 21
   [junit4]   2> 1051006 DEBUG (simCloudManagerPool-1626-thread-50) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=22
   [junit4]   2> 1051006 DEBUG (simCloudManagerPool-1626-thread-50) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 22
   [junit4]   2> 1051027 DEBUG (simCloudManagerPool-1626-thread-52) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for .system / shard1 (currentVersion=23): {"core_node1":{
   [junit4]   2>     "core":".system_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":".system",
   [junit4]   2>     "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 1051046 DEBUG (simCloudManagerPool-1626-thread-51) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=23
   [junit4]   2> 1051046 DEBUG (simCloudManagerPool-1626-thread-51) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 23
   [junit4]   2> 1051047 DEBUG (simCloudManagerPool-1626-thread-49) [    ] o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection .system, currentVersion=24
   [junit4]   2> 1051049 INFO  (ScheduledTrigger-1627-thread-4) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25663597687191251, stage=STARTED, actionName='null', event={
   [junit4]   2>   "id":"5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5",
   [junit4]   2>   "source":"index_size_trigger3",
   [junit4]   2>   "eventTime":25663587459251701,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "aboveSize":{},
   [junit4]   2>     "belowSize":{
   [junit4]   2>       "testMergeIntegration_collection_shard1_replica_n1":"docs=2, bytes=11240",
   [junit4]   2>       "testMergeIntegration_collection_shard2_replica_n3":"docs=3, bytes=11740"},
   [junit4]   2>     "_enqueue_time_":25663592139938551,
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"MERGESHARDS",
   [junit4]   2>         "hints":{"COLL_SHARD":[
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard1"},
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard2"}]}}]}}, context={}, config={
   [junit4]   2>   "trigger":"index_size_trigger3",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener"}, message='null'}
   [junit4]   2> 1051062 DEBUG (ScheduledTrigger-1609-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 1051066 DEBUG (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5",
   [junit4]   2>   "source":"index_size_trigger3",
   [junit4]   2>   "eventTime":25663587459251701,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "aboveSize":{},
   [junit4]   2>     "belowSize":{
   [junit4]   2>       "testMergeIntegration_collection_shard1_replica_n1":"docs=2, bytes=11240",
   [junit4]   2>       "testMergeIntegration_collection_shard2_replica_n3":"docs=3, bytes=11740"},
   [junit4]   2>     "_enqueue_time_":25663592139938551,
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"MERGESHARDS",
   [junit4]   2>         "hints":{"COLL_SHARD":[
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard1"},
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard2"}]}}]}}
   [junit4]   2> 1051067 INFO  (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25663598623709251, stage=BEFORE_ACTION, actionName='compute_plan', event={
   [junit4]   2>   "id":"5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5",
   [junit4]   2>   "source":"index_size_trigger3",
   [junit4]   2>   "eventTime":25663587459251701,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "aboveSize":{},
   [junit4]   2>     "belowSize":{
   [junit4]   2>       "testMergeIntegration_collection_shard1_replica_n1":"docs=2, bytes=11240",
   [junit4]   2>       "testMergeIntegration_collection_shard2_replica_n3":"docs=3, bytes=11740"},
   [junit4]   2>     "_enqueue_time_":25663592139938551,
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"MERGESHARDS",
   [junit4]   2>         "hints":{"COLL_SHARD":[
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard1"},
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard2"}]}}]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger3}, config={
   [junit4]   2>   "trigger":"index_size_trigger3",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener"}, message='null'}
   [junit4]   2> 1051067 DEBUG (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.ComputePlanAction -- processing event: {
   [junit4]   2>   "id":"5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5",
   [junit4]   2>   "source":"index_size_trigger3",
   [junit4]   2>   "eventTime":25663587459251701,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "aboveSize":{},
   [junit4]   2>     "belowSize":{
   [junit4]   2>       "testMergeIntegration_collection_shard1_replica_n1":"docs=2, bytes=11240",
   [junit4]   2>       "testMergeIntegration_collection_shard2_replica_n3":"docs=3, bytes=11740"},
   [junit4]   2>     "_enqueue_time_":25663592139938551,
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"MERGESHARDS",
   [junit4]   2>         "hints":{"COLL_SHARD":[
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard1"},
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard2"}]}}]}} with context properties: {BEFORE_ACTION=[compute_plan]}
   [junit4]   2> 1051070 INFO  (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.ComputePlanAction Computed plan empty, remained 0 requested ops to try.
   [junit4]   2> 1051119 INFO  (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25663598775175301, stage=AFTER_ACTION, actionName='compute_plan', event={
   [junit4]   2>   "id":"5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5",
   [junit4]   2>   "source":"index_size_trigger3",
   [junit4]   2>   "eventTime":25663587459251701,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "aboveSize":{},
   [junit4]   2>     "belowSize":{
   [junit4]   2>       "testMergeIntegration_collection_shard1_replica_n1":"docs=2, bytes=11240",
   [junit4]   2>       "testMergeIntegration_collection_shard2_replica_n3":"docs=3, bytes=11740"},
   [junit4]   2>     "_enqueue_time_":25663592139938551,
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"MERGESHARDS",
   [junit4]   2>         "hints":{"COLL_SHARD":[
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard1"},
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard2"}]}}]}}, context={properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{
   [junit4]   2>   "first":"testMergeIntegration_collection",
   [junit4]   2>   "second":"shard1"}, {
   [junit4]   2>   "first":"testMergeIntegration_collection",
   [junit4]   2>   "second":"shard2"}]}}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger3, properties.AFTER_ACTION=[compute_plan]}, config={
   [junit4]   2>   "trigger":"index_size_trigger3",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener"}, message='null'}
   [junit4]   2> 1051119 INFO  (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25663601234631801, stage=BEFORE_ACTION, actionName='execute_plan', event={
   [junit4]   2>   "id":"5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5",
   [junit4]   2>   "source":"index_size_trigger3",
   [junit4]   2>   "eventTime":25663587459251701,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "aboveSize":{},
   [junit4]   2>     "belowSize":{
   [junit4]   2>       "testMergeIntegration_collection_shard1_replica_n1":"docs=2, bytes=11240",
   [junit4]   2>       "testMergeIntegration_collection_shard2_replica_n3":"docs=3, bytes=11740"},
   [junit4]   2>     "_enqueue_time_":25663592139938551,
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"MERGESHARDS",
   [junit4]   2>         "hints":{"COLL_SHARD":[
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard1"},
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard2"}]}}]}}, context={properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{
   [junit4]   2>   "first":"testMergeIntegration_collection",
   [junit4]   2>   "second":"shard1"}, {
   [junit4]   2>   "first":"testMergeIntegration_collection",
   [junit4]   2>   "second":"shard2"}]}}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger3, properties.AFTER_ACTION=[compute_plan]}, config={
   [junit4]   2>   "trigger":"index_size_trigger3",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener"}, message='null'}
   [junit4]   2> 1051120 DEBUG (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.ExecutePlanAction -- processing event: {
   [junit4]   2>   "id":"5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5",
   [junit4]   2>   "source":"index_size_trigger3",
   [junit4]   2>   "eventTime":25663587459251701,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "aboveSize":{},
   [junit4]   2>     "belowSize":{
   [junit4]   2>       "testMergeIntegration_collection_shard1_replica_n1":"docs=2, bytes=11240",
   [junit4]   2>       "testMergeIntegration_collection_shard2_replica_n3":"docs=3, bytes=11740"},
   [junit4]   2>     "_enqueue_time_":25663592139938551,
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"MERGESHARDS",
   [junit4]   2>         "hints":{"COLL_SHARD":[
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard1"},
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard2"}]}}]}} with context properties: {AFTER_ACTION=[compute_plan], unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{
   [junit4]   2>   "first":"testMergeIntegration_collection",
   [junit4]   2>   "second":"shard1"}, {
   [junit4]   2>   "first":"testMergeIntegration_collection",
   [junit4]   2>   "second":"shard2"}]}}], BEFORE_ACTION=[compute_plan, execute_plan]}
   [junit4]   2> 1051120 INFO  (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.ExecutePlanAction No operations to execute for event: {
   [junit4]   2>   "id":"5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5",
   [junit4]   2>   "source":"index_size_trigger3",
   [junit4]   2>   "eventTime":25663587459251701,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "aboveSize":{},
   [junit4]   2>     "belowSize":{
   [junit4]   2>       "testMergeIntegration_collection_shard1_replica_n1":"docs=2, bytes=11240",
   [junit4]   2>       "testMergeIntegration_collection_shard2_replica_n3":"docs=3, bytes=11740"},
   [junit4]   2>     "_enqueue_time_":25663592139938551,
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"MERGESHARDS",
   [junit4]   2>         "hints":{"COLL_SHARD":[
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard1"},
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard2"}]}}]}}
   [junit4]   2> 1051120 INFO  (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25663601264521401, stage=AFTER_ACTION, actionName='execute_plan', event={
   [junit4]   2>   "id":"5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5",
   [junit4]   2>   "source":"index_size_trigger3",
   [junit4]   2>   "eventTime":25663587459251701,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "aboveSize":{},
   [junit4]   2>     "belowSize":{
   [junit4]   2>       "testMergeIntegration_collection_shard1_replica_n1":"docs=2, bytes=11240",
   [junit4]   2>       "testMergeIntegration_collection_shard2_replica_n3":"docs=3, bytes=11740"},
   [junit4]   2>     "_enqueue_time_":25663592139938551,
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"MERGESHARDS",
   [junit4]   2>         "hints":{"COLL_SHARD":[
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard1"},
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard2"}]}}]}}, context={properties.unsupportedOps=[Op{action=MERGESHARDS, hints={COLL_SHARD=[{
   [junit4]   2>   "first":"testMergeIntegration_collection",
   [junit4]   2>   "second":"shard1"}, {
   [junit4]   2>   "first":"testMergeIntegration_collection",
   [junit4]   2>   "second":"shard2"}]}}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger3, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={
   [junit4]   2>   "trigger":"index_size_trigger3",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener"}, message='null'}
   [junit4]   2> 1051168 INFO  (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=25663603646215301, stage=SUCCEEDED, actionName='null', event={
   [junit4]   2>   "id":"5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5",
   [junit4]   2>   "source":"index_size_trigger3",
   [junit4]   2>   "eventTime":25663587459251701,
   [junit4]   2>   "eventType":"INDEXSIZE",
   [junit4]   2>   "properties":{
   [junit4]   2>     "__start__":1,
   [junit4]   2>     "aboveSize":{},
   [junit4]   2>     "belowSize":{
   [junit4]   2>       "testMergeIntegration_collection_shard1_replica_n1":"docs=2, bytes=11240",
   [junit4]   2>       "testMergeIntegration_collection_shard2_replica_n3":"docs=3, bytes=11740"},
   [junit4]   2>     "_enqueue_time_":25663592139938551,
   [junit4]   2>     "requestedOps":[{
   [junit4]   2>         "action":"MERGESHARDS",
   [junit4]   2>         "hints":{"COLL_SHARD":[
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard1"},
   [junit4]   2>             {
   [junit4]   2>               "first":"testMergeIntegration_collection",
   [junit4]   2>               "second":"shard2"}]}}]}}, context={}, config={
   [junit4]   2>   "trigger":"index_size_trigger3",
   [junit4]   2>   "stage":[
   [junit4]   2>     "STARTED",
   [junit4]   2>     "ABORTED",
   [junit4]   2>     "SUCCEEDED",
   [junit4]   2>     "FAILED"],
   [junit4]   2>   "beforeAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "afterAction":[
   [junit4]   2>     "compute_plan",
   [junit4]   2>     "execute_plan"],
   [junit4]   2>   "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener"}, message='null'}
   [junit4]   2> 1051168 DEBUG (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: index_size_trigger3 after 100ms
   [junit4]   2> 1051168 DEBUG (AutoscalingActionExecutor-1628-thread-1) [    ] o.a.s.c.a.ScheduledTriggers -- processing took 5075 ms for event id=5b2ce5962bbdf5T55vq5q05aj26ruumvf97yx5e5
   [junit4]   2> 1051173 DEBUG (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, currentVersion=24
   [junit4]   2> 1051173 DEBUG (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 24
   [junit4]   2> 1051174 INFO  (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[CC0F0D81016CFDF1]) [    ] o.a.s.c.a.IndexSizeTriggerTest #######################################
   [junit4]   2> ############ CLUSTER STATE ############
   [junit4]   2> #######################################
   [junit4]   2> ## Live nodes: 2
   [junit4]   2> ## Empty nodes: 0
   [junit4]   2> ## Dead nodes: 0
   [junit4]   2> ## Collections:
   [junit4]   2> ##  * .system
   [junit4]   2> ##    shardsTotal 1
   [junit4]   2> ##    shardsState {active=1}
   [junit4]   2> ##      shardsWithoutLeader 0
   [junit4]   2> ##    totalReplicas 2
   [junit4]   2> ##      activeReplicas 2
   [junit4]   2> ##      inactiveReplicas 0
   [junit4]   2> ##    totalActiveDocs 2
   [junit4]   2> ##      bufferedDocs 0
   [junit4]   2> ##      maxActiveSliceDocs 2
   [junit4]   2> ##      minActiveSliceDocs 2
   [junit4]   2> ##      avgActiveSliceDocs 2
   [junit4]   2> ##    totalInactiveDocs 0
   [junit4]   2> ##      maxInactiveSliceDocs 0
   [junit4]   2> ##      minInactiveSliceDocs 0
   [junit4]   2> ##      avgInactiveSliceDocs NaN
   [junit4]   2> ##    totalActiveBytes 11,240
   [junit4]   2> ##      maxActiveSliceBytes 11,240
   [junit4]   2> ##      minActiveSliceBytes 11,240
   [junit4]   2> ##      avgActiveSliceBytes 11,240
   [junit4]   2> ##    totalInactiveBytes 0
   [junit4]   2> ##      maxInactiveSliceBytes 0
   [junit4]   2> ##      minInactiveSliceBytes 0
   [junit4]   2> ##      avgInactiveSliceBytes NaN
   [junit4]   2> ##    totalActiveDeletedDocs 0
   [junit4]   2> ##  * testMergeIntegration_collection
   [junit4]   2> ##    shardsTotal 2
   [junit4]   2> ##    shardsState {active=2}
   [junit4]   2> ##      shardsWithoutLeader 0
   [junit4]   2> ##    totalReplicas 4
   [junit4]   2> ##      activeReplicas 4
   [junit4]   2> ##      inactiveReplicas 0
   [junit4]   2> ##    totalActiveDocs 5
   [junit4]   2> ##      bufferedDocs 0
   [junit4]   2> ##      maxActiveSliceDocs 3
   [junit4]   2> ##      minActiveSliceDocs 2
   [junit4]   2> ##      avgActiveSliceDocs 3
   [junit4]   2> ##    totalInactiveDocs 0
   [junit4]   2> ##      maxInactiveSliceDocs 0
   [junit4]   2> ##      minInactiveSliceDocs 0
   [junit4]   2> ##      avgInactiveSliceDocs NaN
   [junit4]   2> ##    totalActiveBytes 22,980
   [junit4]   2> ##      maxActiveSliceBytes 11,740
   [junit4]   2> ##      minActiveSliceBytes 11,240
   [junit4]   2> ##      avgActiveSliceBytes 11,490
   [junit4]   2> ##    totalInactiveBytes 0
   [junit4]   2> ##      maxInactiveSliceBytes 0
   [junit4]   2> ##      minInactiveSliceBytes 0
   [junit4]   2> ##      avgInactiveSliceBytes NaN
   [junit4]   2> ##    totalActiveDeletedDocs 0
   [junit4]   2> DocCollection(testMergeIntegration_collection//clusterstate.json/24)={
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"2",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"2",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard2":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node3":{
   [junit4]   2>           "core":"testMergeIntegration_collection_shard2_replica_n3",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":8,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":5,
   [junit4]   2>           "INDEX.sizeInBytes":11740,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":1.0933727025985718E-5,
   [junit4]   2>           "SEARCHER.searcher.numDocs":3},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           "core":"testMergeIntegration_collection_shard2_replica_n4",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":8,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":5,
   [junit4]   2>           "INDEX.sizeInBytes":11740,
   [junit4]   2>           "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":1.0933727025985718E-5,
   [junit4]   2>           "SEARCHER.searcher.numDocs":3}},
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active"},
   [junit4]   2>     "shard1":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           "core":"testMergeIntegration_collection_shard1_replica_n1",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":12,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":10,
   [junit4]   2>           "INDEX.sizeInBytes":11240,
   [junit4]   2>           "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":1.0468065738677979E-5,
   [junit4]   2>           "SEARCHER.searcher.numDocs":2},
   [junit4]   2>         "core_node2":{
   [junit4]   2>           "core":"testMergeIntegration_collection_shard1_replica_n2",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":12,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":10,
   [junit4]   2>           "INDEX.sizeInBytes":11240,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":1.0468065738677979E-5,
   [junit4]   2>           "SEARCHER.searcher.numDocs":2}},
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"active"}}}
   [junit4]   2> DocCollection(.system//clusterstate.json/24)={
   [junit4]   2>   "replicationFactor":"2",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           "core":".system_shard1_replica_n1",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":2,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":11240,
   [junit4]   2>           "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":1.0468065738677979E-5,
   [junit4]   2>           "SEARCHER.searcher.numDocs":2},
   [junit4]   2>         "core_node2":{
   [junit4]   2>           "core":".system_shard1_replica_n2",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":2,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":11240,
   [junit4]   2>           "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>           "state":"active",

[...truncated too long message...]

ples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

ivy-fail:

ivy-configure:
[ivy:configure] :: loading settings :: file = /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/lucene/top-level-ivy-settings.xml

resolve:

jar-checksums:
    [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null2047298052
     [copy] Copying 240 files to /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null2047298052
   [delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/null2047298052

check-working-copy:
[ivy:cachepath] :: resolving dependencies :: org.eclipse.jgit#org.eclipse.jgit-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.eclipse.jgit#org.eclipse.jgit;4.6.0.201612231935-r in public
[ivy:cachepath] found com.jcraft#jsch;0.1.53 in public
[ivy:cachepath] found com.googlecode.javaewah#JavaEWAH;1.1.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpclient;4.3.6 in public
[ivy:cachepath] found org.apache.httpcomponents#httpcore;4.3.3 in public
[ivy:cachepath] found commons-logging#commons-logging;1.1.3 in public
[ivy:cachepath] found commons-codec#commons-codec;1.6 in public
[ivy:cachepath] found org.slf4j#slf4j-api;1.7.2 in public
[ivy:cachepath] :: resolution report :: resolve 129ms :: artifacts dl 16ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   8   |   0   |   0   |   0   ||   8   |   0   |
        ---------------------------------------------------------------------
[wc-checker] Initializing working copy...
[wc-checker] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
[wc-checker] SLF4J: Defaulting to no-operation (NOP) logger implementation
[wc-checker] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
[wc-checker] Checking working copy status...

-jenkins-base:

BUILD SUCCESSFUL
Total time: 221 minutes 17 seconds
Archiving artifacts
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$34.hasMatch(FilePath.java:2678)
        at hudson.FilePath$34.invoke(FilePath.java:2557)
        at hudson.FilePath$34.invoke(FilePath.java:2547)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2918)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to lucene2
                at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:955)
                at hudson.FilePath.act(FilePath.java:1036)
                at hudson.FilePath.act(FilePath.java:1025)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
                at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1819)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2920)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath.act(FilePath.java:1038)
        at hudson.FilePath.act(FilePath.java:1025)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2547)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1819)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/hs_err_pid*". Configuration error?
Recording test results
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-BadApples-Tests-master - Build # 222 - Still Unstable

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-BadApples-Tests-master/222/

2 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:42702/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:42702/collection1
        at __randomizedtesting.SeedInfo.seed([386DA1A93D96242D:B0399E73936A49D5]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at org.apache.solr.BaseDistributedSearchTestCase.add(BaseDistributedSearchTestCase.java:509)
        at org.apache.solr.BaseDistributedSearchTestCase.indexDoc(BaseDistributedSearchTestCase.java:498)
        at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:176)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1010)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
        at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
        at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
        at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
        at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
        at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
        at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
        at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
        at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
        at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
        at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
        at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
        at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
        at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
        at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
        ... 48 more


FAILED:  org.apache.solr.cloud.autoscaling.ScheduledTriggerTest.testTrigger

Error Message:
expected:<3> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<3> but was:<2>
        at __randomizedtesting.SeedInfo.seed([386DA1A93D96242D:5BA6972BA4595700]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at org.apache.solr.cloud.autoscaling.ScheduledTriggerTest.scheduledTriggerTest(ScheduledTriggerTest.java:114)
        at org.apache.solr.cloud.autoscaling.ScheduledTriggerTest.testTrigger(ScheduledTriggerTest.java:67)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13799 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_386DA1A93D96242D-001/init-core-data-001
   [junit4]   2> 1802028 WARN  (SUITE-BasicDistributedZkTest-seed#[386DA1A93D96242D]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=54 numCloses=54
   [junit4]   2> 1802028 INFO  (SUITE-BasicDistributedZkTest-seed#[386DA1A93D96242D]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1802030 INFO  (SUITE-BasicDistributedZkTest-seed#[386DA1A93D96242D]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 1802030 INFO  (SUITE-BasicDistributedZkTest-seed#[386DA1A93D96242D]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1802030 INFO  (SUITE-BasicDistributedZkTest-seed#[386DA1A93D96242D]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1802041 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1802041 INFO  (Thread-7512) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1802041 INFO  (Thread-7512) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1802046 ERROR (Thread-7512) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1802141 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.ZkTestServer start zk server on port:43987
   [junit4]   2> 1802150 INFO  (zkConnectionManagerCallback-4325-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1802157 INFO  (zkConnectionManagerCallback-4327-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1802165 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1802167 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1802169 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1802176 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1802177 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1802178 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1802180 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1802181 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1802183 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1802184 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1802186 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1802188 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 1802357 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 1802358 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1802358 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1802358 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1802358 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@14f666ad{/,null,AVAILABLE}
   [junit4]   2> 1802359 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@e428ac3{HTTP/1.1,[http/1.1]}{127.0.0.1:35532}
   [junit4]   2> 1802359 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.Server Started @1802029ms
   [junit4]   2> 1802359 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_386DA1A93D96242D-001/tempDir-001/control/data, hostContext=/, hostPort=35532, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_386DA1A93D96242D-001/control-001/cores}
   [junit4]   2> 1802359 ERROR (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1802359 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1802360 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 1802360 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1802360 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1802360 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-11-28T22:08:25.660Z
   [junit4]   2> 1802362 INFO  (zkConnectionManagerCallback-4329-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1802363 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1802363 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_386DA1A93D96242D-001/control-001/solr.xml
   [junit4]   2> 1802367 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1802368 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1802369 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@56d637d0, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1802706 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43987/solr
   [junit4]   2> 1802708 INFO  (zkConnectionManagerCallback-4333-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1802710 INFO  (zkConnectionManagerCallback-4335-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1802842 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [n:127.0.0.1:35532_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35532_
   [junit4]   2> 1802844 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [n:127.0.0.1:35532_    ] o.a.s.c.Overseer Overseer (id=72357597356294148-127.0.0.1:35532_-n_0000000000) starting
   [junit4]   2> 1802855 INFO  (zkConnectionManagerCallback-4342-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1802858 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [n:127.0.0.1:35532_    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43987/solr ready
   [junit4]   2> 1802859 INFO  (OverseerStateUpdate-72357597356294148-127.0.0.1:35532_-n_0000000000) [n:127.0.0.1:35532_    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:35532_
   [junit4]   2> 1802860 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [n:127.0.0.1:35532_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35532_
   [junit4]   2> 1802861 INFO  (OverseerStateUpdate-72357597356294148-127.0.0.1:35532_-n_0000000000) [n:127.0.0.1:35532_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1802878 INFO  (zkCallback-4341-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1802880 DEBUG (OverseerAutoScalingTriggerThread-72357597356294148-127.0.0.1:35532_-n_0000000000) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:35532_]
   [junit4]   2> 1802886 DEBUG (ScheduledTrigger-8616-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 1802892 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [n:127.0.0.1:35532_    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1802921 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [n:127.0.0.1:35532_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56d637d0
   [junit4]   2> 1802937 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [n:127.0.0.1:35532_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56d637d0
   [junit4]   2> 1802938 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [n:127.0.0.1:35532_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56d637d0
   [junit4]   2> 1802940 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [n:127.0.0.1:35532_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_386DA1A93D96242D-001/control-001/cores
   [junit4]   2> 1802969 INFO  (zkConnectionManagerCallback-4348-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1802970 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1802971 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43987/solr ready
   [junit4]   2> 1802972 INFO  (qtp1365988648-22345) [n:127.0.0.1:35532_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35532_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1802975 INFO  (OverseerThreadFactory-8618-thread-1-processing-n:127.0.0.1:35532_) [n:127.0.0.1:35532_    ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 1802979 DEBUG (OverseerStateUpdate-72357597356294148-127.0.0.1:35532_-n_0000000000) [n:127.0.0.1:35532_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"control_collection",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "createNodeSet":"127.0.0.1:35532_",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 1803082 INFO  (qtp1365988648-22340) [n:127.0.0.1:35532_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1803087 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_    x:control_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1803087 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_    x:control_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1803090 DEBUG (OverseerStateUpdate-72357597356294148-127.0.0.1:35532_-n_0000000000) [n:127.0.0.1:35532_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"control_collection_shard1_replica_n1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35532",
   [junit4]   2>   "node_name":"127.0.0.1:35532_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1803887 DEBUG (ScheduledTrigger-8616-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 1804115 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1804132 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 1804270 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1804293 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 1804293 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56d637d0
   [junit4]   2> 1804293 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_386DA1A93D96242D-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_386DA1A93D96242D-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 1804296 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=6.0341796875, floorSegmentMB=0.501953125, forceMergeDeletesPctAllowed=21.37827079576828, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=27.934081580917454
   [junit4]   2> 1804298 WARN  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1804360 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1804360 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1804362 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1804362 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1804363 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1045612658, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1804364 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@66e21ab5[control_collection_shard1_replica_n1] main]
   [junit4]   2> 1804367 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1804367 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1804368 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1804368 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1618417190350880768
   [junit4]   2> 1804369 INFO  (searcherExecutor-8623-thread-1-processing-n:127.0.0.1:35532_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@66e21ab5[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1804386 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 1804390 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1804390 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1804390 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35532/control_collection_shard1_replica_n1/
   [junit4]   2> 1804391 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1804391 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35532/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 1804395 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35532/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 1804396 DEBUG (OverseerStateUpdate-72357597356294148-127.0.0.1:35532_-n_0000000000) [n:127.0.0.1:35532_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:35532",
   [junit4]   2>   "core":"control_collection_shard1_replica_n1",
   [junit4]   2>   "state":"active"} current state version: 0
   [junit4]   2> 1804548 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1804550 DEBUG (OverseerStateUpdate-72357597356294148-127.0.0.1:35532_-n_0000000000) [n:127.0.0.1:35532_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"control_collection_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35532",
   [junit4]   2>   "node_name":"127.0.0.1:35532_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1804551 INFO  (qtp1365988648-22341) [n:127.0.0.1:35532_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1464
   [junit4]   2> 1804557 INFO  (qtp1365988648-22345) [n:127.0.0.1:35532_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1804651 INFO  (zkCallback-4334-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1804896 DEBUG (ScheduledTrigger-8616-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 1804981 INFO  (OverseerCollectionConfigSetProcessor-72357597356294148-127.0.0.1:35532_-n_0000000000) [n:127.0.0.1:35532_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1805557 INFO  (qtp1365988648-22345) [n:127.0.0.1:35532_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35532_&wt=javabin&version=2} status=0 QTime=2584
   [junit4]   2> 1805563 INFO  (zkConnectionManagerCallback-4353-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1805564 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1805566 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43987/solr ready
   [junit4]   2> 1805566 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1805567 INFO  (qtp1365988648-22344) [n:127.0.0.1:35532_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1805569 INFO  (OverseerThreadFactory-8618-thread-2-processing-n:127.0.0.1:35532_) [n:127.0.0.1:35532_    ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 1805573 DEBUG (OverseerStateUpdate-72357597356294148-127.0.0.1:35532_-n_0000000000) [n:127.0.0.1:35532_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "createNodeSet":"",
   [junit4]   2>   "stateFormat":"1",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 1805773 WARN  (OverseerThreadFactory-8618-thread-2-processing-n:127.0.0.1:35532_) [n:127.0.0.1:35532_    ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 1805779 INFO  (qtp1365988648-22344) [n:127.0.0.1:35532_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1805779 INFO  (qtp1365988648-22344) [n:127.0.0.1:35532_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=212
   [junit4]   2> 1805897 DEBUG (ScheduledTrigger-8616-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1
   [junit4]   2> 1805953 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_386DA1A93D96242D-001/shard-1-001 of type TLOG
   [junit4]   2> 1805953 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 1805955 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1805955 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1805955 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1805955 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35ffcb24{/,null,AVAILABLE}
   [junit4]   2> 1805956 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4451b5f{HTTP/1.1,[http/1.1]}{127.0.0.1:42702}
   [junit4]   2> 1805956 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.e.j.s.Server Started @1805626ms
   [junit4]   2> 1805956 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_386DA1A93D96242D-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=42702, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_386DA1A93D96242D-001/shard-1-001/cores}
   [junit4]   2> 1805956 ERROR (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1805956 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1805957 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 1805957 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1805957 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1805957 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-11-28T22:08:29.257Z
   [junit4]   2> 1805959 INFO  (zkConnectionManagerCallback-4355-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1805960 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1805960 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-BadApples-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_386DA1A93D96242D-001/shard-1-001/solr.xml
   [junit4]   2> 1805964 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1805965 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1805966 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@56d637d0, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1806601 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43987/solr
   [junit4]   2> 1806603 INFO  (zkConnectionManagerCallback-4359-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1806605 INFO  (zkConnectionManagerCallback-4361-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1806614 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1806619 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1806619 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42702_
   [junit4]   2> 1806620 DEBUG (OverseerStateUpdate-72357597356294148-127.0.0.1:35532_-n_0000000000) [n:127.0.0.1:35532_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:42702_"} current state version: 1
   [junit4]   2> 1806620 INFO  (zkCallback-4341-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1806620 INFO  (zkCallback-4352-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1806621 INFO  (zkCallback-4334-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1806626 INFO  (zkCallback-4360-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1806645 INFO  (zkConnectionManagerCallback-4368-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1806646 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1806648 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43987/solr ready
   [junit4]   2> 1806648 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1806677 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56d637d0
   [junit4]   2> 1806695 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@56d637d0
   [junit4]   2> 1806695 INFO  (TEST-BasicDistributedZkTest.test-seed#[386DA1A93D96242D]) [    ] o.a.s.m.r.SolrJmxReporter JMX monit