[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_144) - Build # 1169 - Unstable!

classic Classic list List threaded Threaded
14 messages Options
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_144) - Build # 1169 - Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1169/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseSerialGC

3 tests failed.
FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test

Error Message:
Could not find collection:collection2

Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
        at __randomizedtesting.SeedInfo.seed([E3DBAC311B0AE8DF:6B8F93EBB5F68527]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:913)
        at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:612)
        at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig

Error Message:
expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}>

Stack Trace:
java.lang.AssertionError: expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}>
        at __randomizedtesting.SeedInfo.seed([E3DBAC311B0AE8DF:DC53AF990C5C1838]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig(TestClusterStateProvider.java:214)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.update.processor.TimeRoutedAliasUpdateProcessorTest.testParse

Error Message:
Error from server at http://127.0.0.1:45813/solr: Collection : myalias_2017-10-24 is part of alias myalias remove or modify the alias before removing this collection.

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45813/solr: Collection : myalias_2017-10-24 is part of alias myalias remove or modify the alias before removing this collection.
        at __randomizedtesting.SeedInfo.seed([E3DBAC311B0AE8DF:8C5EE769A77CDB30]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at org.apache.solr.update.processor.TimeRoutedAliasUpdateProcessorTest.doBefore(TimeRoutedAliasUpdateProcessorTest.java:84)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11961 lines...]
   [junit4] Suite: org.apache.solr.update.processor.TimeRoutedAliasUpdateProcessorTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/init-core-data-001
   [junit4]   2> 402658 WARN  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[E3DBAC311B0AE8DF]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=555 numCloses=555
   [junit4]   2> 402658 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[E3DBAC311B0AE8DF]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 402659 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[E3DBAC311B0AE8DF]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 402659 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[E3DBAC311B0AE8DF]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 402660 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[E3DBAC311B0AE8DF]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001
   [junit4]   2> 402660 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[E3DBAC311B0AE8DF]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 402665 INFO  (Thread-376) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 402665 INFO  (Thread-376) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 402669 ERROR (Thread-376) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 402765 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[E3DBAC311B0AE8DF]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:39275
   [junit4]   2> 402769 INFO  (zkConnectionManagerCallback-508-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 402774 INFO  (jetty-launcher-505-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 402780 INFO  (jetty-launcher-505-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 402780 INFO  (jetty-launcher-505-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1951d7a{/solr,null,AVAILABLE}
   [junit4]   2> 402781 INFO  (jetty-launcher-505-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9ac1c{/solr,null,AVAILABLE}
   [junit4]   2> 402783 INFO  (jetty-launcher-505-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@510b4f{HTTP/1.1,[http/1.1]}{127.0.0.1:45813}
   [junit4]   2> 402783 INFO  (jetty-launcher-505-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1dbbf96{HTTP/1.1,[http/1.1]}{127.0.0.1:37347}
   [junit4]   2> 402783 INFO  (jetty-launcher-505-thread-2) [    ] o.e.j.s.Server Started @404202ms
   [junit4]   2> 402783 INFO  (jetty-launcher-505-thread-1) [    ] o.e.j.s.Server Started @404202ms
   [junit4]   2> 402783 INFO  (jetty-launcher-505-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45813}
   [junit4]   2> 402783 INFO  (jetty-launcher-505-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37347}
   [junit4]   2> 402783 ERROR (jetty-launcher-505-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 402783 ERROR (jetty-launcher-505-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 402783 INFO  (jetty-launcher-505-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 402783 INFO  (jetty-launcher-505-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 402783 INFO  (jetty-launcher-505-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 402784 INFO  (jetty-launcher-505-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 402784 INFO  (jetty-launcher-505-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 402784 INFO  (jetty-launcher-505-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 402784 INFO  (jetty-launcher-505-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-12T16:31:08.574Z
   [junit4]   2> 402784 INFO  (jetty-launcher-505-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-12T16:31:08.574Z
   [junit4]   2> 402793 INFO  (zkConnectionManagerCallback-511-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 402794 INFO  (jetty-launcher-505-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 402794 INFO  (zkConnectionManagerCallback-512-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 402794 INFO  (jetty-launcher-505-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 402808 INFO  (jetty-launcher-505-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39275/solr
   [junit4]   2> 402812 INFO  (zkConnectionManagerCallback-517-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 402813 INFO  (jetty-launcher-505-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39275/solr
   [junit4]   2> 402818 INFO  (zkConnectionManagerCallback-520-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 402825 INFO  (zkConnectionManagerCallback-522-thread-1-processing-n:127.0.0.1:45813_solr) [n:127.0.0.1:45813_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 402833 INFO  (zkConnectionManagerCallback-524-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 402846 INFO  (jetty-launcher-505-thread-1) [n:127.0.0.1:37347_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 402847 INFO  (jetty-launcher-505-thread-1) [n:127.0.0.1:37347_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37347_solr
   [junit4]   2> 402847 INFO  (jetty-launcher-505-thread-1) [n:127.0.0.1:37347_solr    ] o.a.s.c.Overseer Overseer (id=99337808671932422-127.0.0.1:37347_solr-n_0000000000) starting
   [junit4]   2> 402873 INFO  (jetty-launcher-505-thread-1) [n:127.0.0.1:37347_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37347_solr
   [junit4]   2> 402877 INFO  (OverseerStateUpdate-99337808671932422-127.0.0.1:37347_solr-n_0000000000) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 402889 INFO  (jetty-launcher-505-thread-2) [n:127.0.0.1:45813_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 402890 INFO  (jetty-launcher-505-thread-2) [n:127.0.0.1:45813_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 402893 INFO  (jetty-launcher-505-thread-2) [n:127.0.0.1:45813_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45813_solr
   [junit4]   2> 402902 INFO  (zkCallback-523-thread-2-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 402903 INFO  (zkCallback-521-thread-1-processing-n:127.0.0.1:45813_solr) [n:127.0.0.1:45813_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 403033 INFO  (jetty-launcher-505-thread-1) [n:127.0.0.1:37347_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37347.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b315fc
   [junit4]   2> 403033 INFO  (jetty-launcher-505-thread-2) [n:127.0.0.1:45813_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45813.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b315fc
   [junit4]   2> 403042 INFO  (jetty-launcher-505-thread-1) [n:127.0.0.1:37347_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37347.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b315fc
   [junit4]   2> 403042 INFO  (jetty-launcher-505-thread-2) [n:127.0.0.1:45813_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45813.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b315fc
   [junit4]   2> 403042 INFO  (jetty-launcher-505-thread-1) [n:127.0.0.1:37347_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37347.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b315fc
   [junit4]   2> 403042 INFO  (jetty-launcher-505-thread-2) [n:127.0.0.1:45813_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45813.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b315fc
   [junit4]   2> 403043 INFO  (jetty-launcher-505-thread-1) [n:127.0.0.1:37347_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/.
   [junit4]   2> 403043 INFO  (jetty-launcher-505-thread-2) [n:127.0.0.1:45813_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node2/.
   [junit4]   2> 403090 INFO  (zkConnectionManagerCallback-530-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 403104 INFO  (TEST-TimeRoutedAliasUpdateProcessorTest.test-seed#[E3DBAC311B0AE8DF]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 403106 INFO  (zkConnectionManagerCallback-535-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 403107 INFO  (TEST-TimeRoutedAliasUpdateProcessorTest.test-seed#[E3DBAC311B0AE8DF]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 403107 INFO  (TEST-TimeRoutedAliasUpdateProcessorTest.test-seed#[E3DBAC311B0AE8DF]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39275/solr ready
   [junit4]   2> 403108 INFO  (qtp17948987-2797) [n:127.0.0.1:45813_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 403108 INFO  (qtp17948987-2797) [n:127.0.0.1:45813_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 403109 INFO  (qtp17948987-2798) [n:127.0.0.1:45813_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&name=timeConfig&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 403110 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.CreateCollectionCmd Create collection timeConfig
   [junit4]   2> 403110 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.CreateCollectionCmd Only _default config set found, using it.
   [junit4]   2> 403111 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/timeConfig/protwords.txt
   [junit4]   2> 403111 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/timeConfig/managed-schema
   [junit4]   2> 403112 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/timeConfig/solrconfig.xml
   [junit4]   2> 403113 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/timeConfig/synonyms.txt
   [junit4]   2> 403114 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/timeConfig/stopwords.txt
   [junit4]   2> 403115 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/timeConfig/lang/contractions_it.txt
   [junit4]   2> 403115 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/timeConfig/lang/stemdict_nl.txt
   [junit4]   2> 403116 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/timeConfig/lang/stopwords_hy.txt
   [junit4]   2> 403116 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/timeConfig/lang/stopwords_no.txt
   [junit4]   2> 403117 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/timeConfig/lang/contractions_ca.txt
   [junit4]   2> 403118 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/timeConfig/lang/stopwords_id.txt
   [junit4]   2> 403118 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/timeConfig/lang/stopwords_ga.txt
   [junit4]   2> 403119 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/timeConfig/lang/stopwords_hi.txt
   [junit4]   2> 403119 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/timeConfig/lang/stopwords_da.txt
   [junit4]   2> 403120 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/timeConfig/lang/stopwords_ja.txt
   [junit4]   2> 403121 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/timeConfig/lang/stopwords_pt.txt
   [junit4]   2> 403121 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/timeConfig/lang/stopwords_hu.txt
   [junit4]   2> 403122 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/timeConfig/lang/stopwords_el.txt
   [junit4]   2> 403122 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/timeConfig/lang/stopwords_ru.txt
   [junit4]   2> 403123 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/timeConfig/lang/stopwords_tr.txt
   [junit4]   2> 403123 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/timeConfig/lang/stopwords_ar.txt
   [junit4]   2> 403124 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/timeConfig/lang/userdict_ja.txt
   [junit4]   2> 403124 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/timeConfig/lang/stopwords_eu.txt
   [junit4]   2> 403125 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/timeConfig/lang/stopwords_it.txt
   [junit4]   2> 403125 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/timeConfig/lang/stopwords_cz.txt
   [junit4]   2> 403126 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/timeConfig/lang/stoptags_ja.txt
   [junit4]   2> 403126 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/timeConfig/lang/contractions_fr.txt
   [junit4]   2> 403127 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/timeConfig/lang/stopwords_de.txt
   [junit4]   2> 403128 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/timeConfig/lang/stopwords_fa.txt
   [junit4]   2> 403129 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/timeConfig/lang/contractions_ga.txt
   [junit4]   2> 403129 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/timeConfig/lang/stopwords_ca.txt
   [junit4]   2> 403130 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/timeConfig/lang/stopwords_nl.txt
   [junit4]   2> 403131 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/timeConfig/lang/stopwords_bg.txt
   [junit4]   2> 403132 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/timeConfig/lang/stopwords_lv.txt
   [junit4]   2> 403133 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/timeConfig/lang/stopwords_en.txt
   [junit4]   2> 403134 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/timeConfig/lang/stopwords_es.txt
   [junit4]   2> 403135 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/timeConfig/lang/stopwords_th.txt
   [junit4]   2> 403135 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/timeConfig/lang/stopwords_ro.txt
   [junit4]   2> 403136 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/timeConfig/lang/stopwords_fr.txt
   [junit4]   2> 403136 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/timeConfig/lang/stopwords_sv.txt
   [junit4]   2> 403137 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/timeConfig/lang/stopwords_fi.txt
   [junit4]   2> 403137 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/timeConfig/lang/hyphenations_ga.txt
   [junit4]   2> 403138 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/timeConfig/lang/stopwords_gl.txt
   [junit4]   2> 403138 INFO  (OverseerThreadFactory-832-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/timeConfig/params.json
   [junit4]   2> 403243 INFO  (OverseerStateUpdate-99337808671932422-127.0.0.1:37347_solr-n_0000000000) [n:127.0.0.1:37347_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"timeConfig",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"timeConfig_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37347/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 403445 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=timeConfig&newCollection=true&name=timeConfig_shard1_replica_n1&action=CREATE&numShards=1&collection=timeConfig&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 403445 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 403548 INFO  (zkCallback-523-thread-2-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 403548 INFO  (zkCallback-523-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 404456 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
   [junit4]   2> 404456 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 404457 WARN  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/extraction/lib
   [junit4]   2> 404457 WARN  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 404457 WARN  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/clustering/lib
   [junit4]   2> 404457 WARN  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 404458 WARN  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/langid/lib
   [junit4]   2> 404458 WARN  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 404458 WARN  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/velocity/lib
   [junit4]   2> 404458 WARN  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 404464 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 404483 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.IndexSchema [timeConfig_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 404611 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 404633 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'timeConfig_shard1_replica_n1' using configuration from collection timeConfig, trusted=true
   [junit4]   2> 404633 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37347.solr.core.timeConfig.shard1.replica_n1' (registry 'solr.core.timeConfig.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b315fc
   [junit4]   2> 404634 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 404634 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [[timeConfig_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/./timeConfig_shard1_replica_n1/data/]
   [junit4]   2> 404639 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 404702 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 404703 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 404704 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
   [junit4]   2> 404704 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 404706 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@9680d5[timeConfig_shard1_replica_n1] main]
   [junit4]   2> 404707 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/timeConfig
   [junit4]   2> 404707 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/timeConfig
   [junit4]   2> 404707 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/timeConfig/managed-schema
   [junit4]   2> 404707 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 404708 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 404708 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 404711 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 404711 INFO  (searcherExecutor-837-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@9680d5[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 404711 INFO  (searcherExecutor-837-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 404711 INFO  (searcherExecutor-837-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 404711 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589404940895256576
   [junit4]   2> 404712 INFO  (searcherExecutor-837-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [timeConfig_shard1_replica_n1] Registered new searcher Searcher@9680d5[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 404714 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 404714 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 404715 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37347/solr/timeConfig_shard1_replica_n1/
   [junit4]   2> 404715 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 404715 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:37347/solr/timeConfig_shard1_replica_n1/ has no replicas
   [junit4]   2> 404715 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 404716 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37347/solr/timeConfig_shard1_replica_n1/ shard1
   [junit4]   2> 404817 INFO  (zkCallback-523-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 404817 INFO  (zkCallback-523-thread-3-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 404867 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 404907 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=timeConfig&newCollection=true&name=timeConfig_shard1_replica_n1&action=CREATE&numShards=1&collection=timeConfig&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1462
   [junit4]   2> 404909 INFO  (qtp17948987-2798) [n:127.0.0.1:45813_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 404969 INFO  (zkCallback-523-thread-3-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 404969 INFO  (zkCallback-523-thread-1-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 405111 INFO  (OverseerCollectionConfigSetProcessor-99337808671932422-127.0.0.1:37347_solr-n_0000000000) [n:127.0.0.1:37347_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 405910 INFO  (qtp17948987-2798) [n:127.0.0.1:45813_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&name=timeConfig&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=2801
   [junit4]   2> 405926 INFO  (qtp33503179-2790) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Executed config commands successfully and persisted to ZK [{"set-user-property":{"timePartitionAliasName":"myalias"}}, {"set-user-property":{"update.autoCreateFields":false}}, {"add-updateprocessor":{
   [junit4]   2>     "name":"tolerant",
   [junit4]   2>     "class":"solr.TolerantUpdateProcessorFactory"}}, {"add-updateprocessor":{
   [junit4]   2>     "name":"inc",
   [junit4]   2>     "class":"org.apache.solr.update.processor.TimeRoutedAliasUpdateProcessorTest$IncrementURPFactory",
   [junit4]   2>     "fieldName":"integer_i"}}]
   [junit4]   2> 405926 INFO  (qtp33503179-2790) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Waiting up to 30 secs for 1 replicas to set the property overlay to be of version 0 for collection timeConfig
   [junit4]   2> 405926 INFO  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrCore config update listener called for core timeConfig_shard1_replica_n1
   [junit4]   2> 405926 INFO  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrCore core reload timeConfig_shard1_replica_n1
   [junit4]   2> 405927 INFO  (solrHandlerExecutor-842-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 405931 INFO  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
   [junit4]   2> 405931 INFO  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 405932 WARN  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/extraction/lib
   [junit4]   2> 405932 WARN  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 405932 WARN  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/clustering/lib
   [junit4]   2> 405932 WARN  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 405933 WARN  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/langid/lib
   [junit4]   2> 405933 WARN  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 405933 WARN  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../contrib/velocity/lib
   [junit4]   2> 405933 WARN  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 405937 INFO  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 405948 INFO  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.s.IndexSchema [timeConfig_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 406028 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 406028 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.S.Request [timeConfig_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 406028 INFO  (SolrConfigHandler-refreshconf) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 406029 INFO  (solrHandlerExecutor-842-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:37347/solr/timeConfig_shard1_replica_n1/ for prop overlay   after 1 attempts
   [junit4]   2> 406029 INFO  (solrHandlerExecutor-842-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 406047 INFO  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 406061 INFO  (Thread-395) [n:127.0.0.1:37347_solr    ] o.a.s.c.CoreContainer Reloading SolrCore 'timeConfig_shard1_replica_n1' using configuration from collection timeConfig
   [junit4]   2> 406089 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37347.solr.core.timeConfig.shard1.replica_n1' (registry 'solr.core.timeConfig.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1b315fc
   [junit4]   2> 406089 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [[timeConfig_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/timeConfig_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_E3DBAC311B0AE8DF-001/tempDir-001/node1/./timeConfig_shard1_replica_n1/data/]
   [junit4]   2> 406092 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 406129 INFO  (qtp33503179-2784) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 406129 INFO  (qtp33503179-2784) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.S.Request [timeConfig_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 406129 INFO  (SolrConfigHandler-refreshconf) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 406130 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
   [junit4]   2> 406130 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 406130 INFO  (solrHandlerExecutor-842-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:37347/solr/timeConfig_shard1_replica_n1/ for prop overlay   after 2 attempts
   [junit4]   2> 406130 INFO  (solrHandlerExecutor-842-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 406131 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1729911[timeConfig_shard1_replica_n1] main]
   [junit4]   2> 406132 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/timeConfig
   [junit4]   2> 406132 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/timeConfig
   [junit4]   2> 406132 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/timeConfig/managed-schema
   [junit4]   2> 406133 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 406133 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 406133 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 406134 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 406134 INFO  (searcherExecutor-843-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@1729911[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 406134 INFO  (searcherExecutor-843-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 406134 INFO  (searcherExecutor-843-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 406134 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589404942387380224
   [junit4]   2> 406137 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 406139 INFO  (searcherExecutor-843-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [timeConfig_shard1_replica_n1] Registered new searcher Searcher@1729911[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 406139 INFO  (Thread-395) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@ac5d1e[timeConfig_shard1_replica_n1] main]
   [junit4]   2> 406139 INFO  (searcherExecutor-843-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@ac5d1e[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 406139 INFO  (searcherExecutor-843-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 406142 INFO  (searcherExecutor-843-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [timeConfig_shard1_replica_n1] Registered new searcher Searcher@ac5d1e[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 406230 INFO  (qtp33503179-2786) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler I already have the expected version 0 of config
   [junit4]   2> 406231 INFO  (qtp33503179-2786) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler isStale false , resourceloader org.apache.solr.cloud.ZkSolrResourceLoader
   [junit4]   2> 406231 INFO  (qtp33503179-2786) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.S.Request [timeConfig_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 406231 INFO  (qtp33503179-2790) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Took 305.0ms to set the property overlay to be of version 0 for collection timeConfig
   [junit4]   2> 406231 INFO  (qtp33503179-2790) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [timeConfig_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@c7a553
   [junit4]   2> 406231 INFO  (qtp33503179-2790) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.timeConfig.shard1.replica_n1, tag=13083987
   [junit4]   2> 406231 INFO  (qtp33503179-2790) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@45fb8f: rootName = solr_37347, domain = solr.core.timeConfig.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.timeConfig.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@123379c
   [junit4]   2> 406242 INFO  (qtp33503179-2790) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.timeConfig.shard1.leader, tag=13083987
   [junit4]   2> 406247 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ZkController Persisted config data to node /configs/timeConfig/params.json
   [junit4]   2> 406247 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Waiting up to 30 secs for 1 replicas to set the property params to be of version 1 for collection timeConfig
   [junit4]   2> 406247 INFO  (Thread-396) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrCore config update listener called for core timeConfig_shard1_replica_n1
   [junit4]   2> 406248 INFO  (Thread-396) [n:127.0.0.1:37347_solr    ] o.a.s.c.RequestParams conf resource params.json loaded . version : 1
   [junit4]   2> 406248 INFO  (Thread-396) [n:127.0.0.1:37347_solr    ] o.a.s.c.RequestParams request params refreshed to version 1
   [junit4]   2> 406248 INFO  (solrHandlerExecutor-847-thread-1-processing-n:127.0.0.1:37347_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 406349 INFO  (qtp33503179-2790) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler I already have the expected version 1 of params
   [junit4]   2> 406349 INFO  (qtp33503179-2790) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler isStale false , resourceloader org.apache.solr.cloud.ZkSolrResourceLoader
   [junit4]   2> 406349 INFO  (qtp33503179-2790) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.S.Request [timeConfig_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={params=1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 406350 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Took 102.0ms to set the property params to be of version 1 for collection timeConfig
   [junit4]   2> 406350 INFO  (qtp33503179-2788) [n:127.0.0.1:37347_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.S.Request [timeConfig_shard1_replica_n1]  webapp=/solr path=/config/params params={wt=javabin&version=2} status=0 QTime=103
   [junit4]   2> 406350 INFO  (qtp17948987-2792) [n:127.0.0.1:45813_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=timeConfig&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 406351 INFO  (OverseerThreadFactory-832-thread-2-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 406352 INFO  (qtp33503179-2789) [n:127.0.0.1:37347_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.timeConfig.shard1.replica_n1, tag=null
   [junit4]   2> 406352 INFO  (qtp33503179-2789) [n:127.0.0.1:37347_solr    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1a9bec1: rootName = solr_37347, domain = solr.core.timeConfig.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.timeConfig.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@123379c
   [junit4]   2> 406369 INFO  (qtp33503179-2789) [n:127.0.0.1:37347_solr    ] o.a.s.c.SolrCore [timeConfig_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@122b401
   [junit4]   2> 406369 INFO  (qtp33503179-2789) [n:127.0.0.1:37347_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.timeConfig.shard1.replica_n1, tag=19051521
   [junit4]   2> 406369 INFO  (qtp33503179-2789) [n:127.0.0.1:37347_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.timeConfig.shard1.leader, tag=19051521
   [junit4]   2> 406372 INFO  (qtp33503179-2789) [n:127.0.0.1:37347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=timeConfig_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=20
   [junit4]   2> 407075 INFO  (qtp17948987-2792) [n:127.0.0.1:45813_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=timeConfig&action=DELETE&wt=javabin&version=2} status=0 QTime=724
   [junit4]   2> 407075 INFO  (qtp17948987-2797) [n:127.0.0.1:45813_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&property.timePartitionAliasName=myalias&collection.configName=timeConfig&maxShardsPerNode=2&name=myalias_2017-10-23&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 407077 INFO  (OverseerThreadFactory-832-thread-3-processing-n:127.0.0.1:37347_solr) [n:127.0.0.1:37347_solr    ] o.a.s.c.CreateCollectionCmd Create collection myalias_2017-10-23
   [junit4]   2> 407077 INFO  (OverseerCollectionConfigSetProcessor-99337808671932422-127.0.0.1:37347_solr-n_0000000000) [n:127.0.0.1:37347_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 407282 INFO  (OverseerStateUpdate-99337808671932422-127.0.0.1:37347_solr-n_0000000000) [n:127.0.0.1:37347_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"myalias_2017-10-23",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"myalias_2017-10-23_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37347/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 407283 INFO  (OverseerStateUpdate-99337808671932422-127.0.0.1:37347_solr-n_0000000000) [n:127.0.0.1:37347_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"myalias_2017-10-23",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"myalias_2017-10-23_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45813/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 407284 INFO  (OverseerStateUpdate-99337808671932422-127.0.0.1:37347_solr-n_0000000000) [n:127.0.0.1:37347_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"myalias_2017-10-23",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"myalias_2017-10-23_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37347/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 407285 INFO  (OverseerStateUpdate-99337808671932422-127.0.0.1:37347_solr-n_0000000000) [n:127.0.0.1:37347_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"myalias_2017-10-23",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"myalias_2017-10-23_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45813/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 407486 INFO  (qtp33503179-2785) [n:127.0.0.1:37347_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=timeConfig&newCollection=true&collection=myalias_2017-10-23&version=2&replicaType=NRT&coreNodeName=core_node3&property.timePartitionAliasName=myalias&name=myalias_2017-10-23_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin
   [junit4]   2> 407487 INFO  (qtp33503179-2783) [n:127.0.0.1:37347_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=timeConfig&newCollection=true&collection=myalias_2017-10-23&version=2&replicaType=NRT&coreNodeName=core_node7&property.timePartitionAliasName=myalias&name=myalias_2017-10-23_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&wt=javabin
   [junit4]   2> 407487 INFO  (qtp17948987-2793) [n:127.0.0.1:45813_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=timeConfig&newCollection=true&collection=myalias_2017-10-23&version=2&replicaType=NRT&coreNodeName=core_node5&property.timePartitionAliasName=myalias&name=myalias_2017-10-23_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&wt=javabin
   [junit4]   2> 407487 INFO  (qtp17948987-2794) [n:127.0.0.1:45813_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=timeConfig&newCollection=true&collection=myalias_2017-10-23&version=2&replicaType=NRT&coreNodeName=core_node8&property.timePartitionAliasName=myalias&name=myalias_2017-10-23_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&wt=javabin
   [junit4]   2> 407487 INFO  (qtp17948987-2793) [n:127.0.0.1:45813_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 407590 INFO  (zkCallback-521-thread-1-processing-n:127.0.0.1:45813_solr) [n:127.0.0.1:45813_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:N

[...truncated too long message...]

0.1:43867_-n_0000000005) closing
   [junit4]   2> 1846934 INFO  (OverseerStateUpdate-99337899303174165-127.0.0.1:43867_-n_0000000005) [n:127.0.0.1:43867_    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43867_
   [junit4]   2> 1846934 WARN  (OverseerAutoScalingTriggerThread-99337899303174165-127.0.0.1:43867_-n_0000000005) [n:127.0.0.1:43867_    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1846937 WARN  (ScheduledTrigger-5695-thread-1) [n:127.0.0.1:43867_    ] o.a.s.c.a.TriggerBase Exception updating trigger state '/autoscaling/triggerState/.auto_add_replicas'
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2> at java.lang.Object.wait(Native Method)
   [junit4]   2> at java.lang.Object.wait(Object.java:502)
   [junit4]   2> at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1406)
   [junit4]   2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1097)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.lambda$exists$3(SolrZkClient.java:315)
   [junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:315)
   [junit4]   2> at org.apache.solr.client.solrj.impl.ZkDistribStateManager.hasData(ZkDistribStateManager.java:57)
   [junit4]   2> at org.apache.solr.cloud.autoscaling.TriggerBase.saveState(TriggerBase.java:203)
   [junit4]   2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers$ScheduledTrigger.run(ScheduledTriggers.java:544)
   [junit4]   2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
   [junit4]   2> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
   [junit4]   2> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
   [junit4]   2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1846937 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E3DBAC311B0AE8DF]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1fd7448{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1846938 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E3DBAC311B0AE8DF]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@31de25{/,null,UNAVAILABLE}
   [junit4]   2> 1846938 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E3DBAC311B0AE8DF]) [    ] o.a.s.c.ChaosMonkey monkey: stop jetty! 33229
   [junit4]   2> 1846938 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E3DBAC311B0AE8DF]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1846939 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E3DBAC311B0AE8DF]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41431 41431
   [junit4]   2> 1852742 INFO  (Thread-9226) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41431 41431
   [junit4]   2> 1852743 WARN  (Thread-9226) [    ] o.a.s.c.ZkTestServer Watch limit violations:
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2>
   [junit4]   2> 15 /solr/aliases.json
   [junit4]   2> 11 /solr/configs/conf1
   [junit4]   2> 7 /solr/security.json
   [junit4]   2>
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2>
   [junit4]   2> 15 /solr/clusterprops.json
   [junit4]   2> 15 /solr/clusterstate.json
   [junit4]   2> 6 /solr/collections/collection1/state.json
   [junit4]   2> 5 /solr/autoscaling.json
   [junit4]   2> 5 /solr/collections/collection2/state.json
   [junit4]   2> 2 /solr/overseer_elect/election/99337899303174156-127.0.0.1:44075_-n_0000000002
   [junit4]   2>
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2>
   [junit4]   2> 15 /solr/live_nodes
   [junit4]   2> 15 /solr/collections
   [junit4]   2> 5 /solr/overseer/queue
   [junit4]   2> 5 /solr/overseer/collection-queue-work
   [junit4]   2> 5 /solr/overseer/queue-work
   [junit4]   2> 3 /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2>
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudDistribCmdsTest -Dtests.method=test -Dtests.seed=E3DBAC311B0AE8DF -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ca-ES -Dtests.timezone=America/Hermosillo -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 67.5s J0 | FullSolrCloudDistribCmdsTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Could not find collection:collection2
   [junit4]    > at __randomizedtesting.SeedInfo.seed([E3DBAC311B0AE8DF:6B8F93EBB5F68527]:0)
   [junit4]    > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
   [junit4]    > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
   [junit4]    > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
   [junit4]    > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:913)
   [junit4]    > at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:612)
   [junit4]    > at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
   [junit4]    > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
   [junit4]    > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E3DBAC311B0AE8DF-001
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=ca-ES, timezone=America/Hermosillo
   [junit4]   2> NOTE: Linux 4.13.0-26-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=159062344,total=429551616
   [junit4]   2> NOTE: All tests run in this JVM: [TestFastOutputStream, TestReqParamsAPI, SearchRateTriggerTest, RulesTest, TestLuceneIndexBackCompat, JsonLoaderTest, TestRequestStatusCollectionAPI, TestUtils, TestReversedWildcardFilterFactory, HighlighterMaxOffsetTest, OutOfBoxZkACLAndCredentialsProvidersTest, SpatialFilterTest, TestDocTermOrds, TriggerIntegrationTest, SimpleFacetsTest, TestReplicationHandler, ConnectionManagerTest, TestFoldingMultitermQuery, TestTlogReplica, TestRawTransformer, TestLegacyField, TestPivotHelperCode, DateFieldTest, TestDownShardTolerantSearch, TestDFRSimilarityFactory, TestRandomDVFaceting, PropertiesRequestHandlerTest, AnalysisErrorHandlingTest, SmileWriterTest, HdfsNNFailoverTest, URLClassifyProcessorTest, TestCloudPseudoReturnFields, StressHdfsTest, TestCloudNestedDocsSort, TestLegacyNumericRangeQueryBuilder, TestSystemCollAutoCreate, DistributedQueueTest, TestShortCircuitedRequests, TestRTimerTree, NumberUtilsTest, TestSimpleTextCodec, TestGraphTermsQParserPlugin, DistributedMLTComponentTest, TestExportWriter, TestJsonFacets, CursorPagingTest, TestScoreJoinQPScore, SaslZkACLProviderTest, TestConfigSetsAPI, TestStressCloudBlindAtomicUpdates, TemplateUpdateProcessorTest, ZkStateWriterTest, AutoscalingHistoryHandlerTest, CollectionsAPISolrJTest, TestSweetSpotSimilarityFactory, TestPayloadCheckQParserPlugin, CdcrVersionReplicationTest, TestRecoveryHdfs, TolerantUpdateProcessorTest, TestManagedSchemaAPI, PeerSyncWithIndexFingerprintCachingTest, UtilsToolTest, TestIndexingPerformance, SoftAutoCommitTest, TestPolicyCloud, SolrGangliaReporterTest, TestSortByMinMaxFunction, TestSubQueryTransformerDistrib, TestStressVersions, TestWordDelimiterFilterFactory, TestCloudInspectUtil, SearchHandlerTest, TestPostingsSolrHighlighter, BasicZkTest, CleanupOldIndexTest, TestLocalFSCloudBackupRestore, RankQueryTest, TermVectorComponentTest, EnumFieldTest, ResponseLogComponentTest, PrimitiveFieldTypeTest, TestSQLHandlerNonCloud, TestEmbeddedSolrServerSchemaAPI, CursorMarkTest, NoCacheHeaderTest, ParsingFieldUpdateProcessorsTest, VMParamsZkACLAndCredentialsProvidersTest, TestSolrDeletionPolicy1, TestUseDocValuesAsStored2, TestChildDocTransformer, TestExceedMaxTermLength, TermsComponentTest, LeaderFailoverAfterPartitionTest, DirectUpdateHandlerOptimizeTest, HdfsTlogReplayBufferedWhileIndexingTest, OverseerTaskQueueTest, QueryResultKeyTest, SolrInfoBeanTest, UninvertDocValuesMergePolicyTest, BufferStoreTest, TestBinaryField, TestSchemaNameResource, TestHighlightDedupGrouping, TestImplicitCoreProperties, SliceStateTest, ZkControllerTest, StatsReloadRaceTest, TestSolrCloudSnapshots, BaseCdcrDistributedZkTest, TestInPlaceUpdatesStandalone, TestSchemaManager, TestLeaderElectionWithEmptyReplica, BlockJoinFacetRandomTest, SolrShardReporterTest, TestNRTOpen, IndexSchemaRuntimeFieldTest, TestBadConfig, ExecutePlanActionTest, BadCopyFieldTest, TestPhraseSuggestions, HdfsRestartWhileUpdatingTest, TestDelegationWithHadoopAuth, DistributedDebugComponentTest, FastVectorHighlighterTest, TestCustomSort, DeleteReplicaTest, SyncSliceTest, LeaderElectionIntegrationTest, FullSolrCloudDistribCmdsTest]
   [junit4] Completed [388/766 (3!)] on J0 in 67.57s, 1 test, 1 failure <<< FAILURES!

[...truncated 45197 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+37) - Build # 1170 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1170/
Java: 64bit/jdk-10-ea+37 -XX:-UseCompressedOops -XX:+UseParallelGC

3 tests failed.
FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testMultiVariateNormalDistribution

Error Message:


Stack Trace:
java.lang.AssertionError
        at __randomizedtesting.SeedInfo.seed([5E9A2644272FE770:C461AF331006A57B]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testMultiVariateNormalDistribution(StreamExpressionTest.java:7549)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig

Error Message:
expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}>

Stack Trace:
java.lang.AssertionError: expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}>
        at __randomizedtesting.SeedInfo.seed([23A4129031B5ED54:1C2C113826E31DB3]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig(TestClusterStateProvider.java:214)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.update.processor.TimeRoutedAliasUpdateProcessorTest.testParse

Error Message:
Error from server at http://127.0.0.1:33389/solr: Collection : myalias_2017-10-24 is part of alias myalias remove or modify the alias before removing this collection.

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:33389/solr: Collection : myalias_2017-10-24 is part of alias myalias remove or modify the alias before removing this collection.
        at __randomizedtesting.SeedInfo.seed([23A4129031B5ED54:4C2159C88DC3DEBB]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at org.apache.solr.update.processor.TimeRoutedAliasUpdateProcessorTest.doBefore(TimeRoutedAliasUpdateProcessorTest.java:84)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12931 lines...]
   [junit4] Suite: org.apache.solr.update.processor.TimeRoutedAliasUpdateProcessorTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/init-core-data-001
   [junit4]   2> 1386588 WARN  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[23A4129031B5ED54]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=11 numCloses=11
   [junit4]   2> 1386588 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[23A4129031B5ED54]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1386589 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[23A4129031B5ED54]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 1386589 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[23A4129031B5ED54]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1386589 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[23A4129031B5ED54]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001
   [junit4]   2> 1386589 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[23A4129031B5ED54]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1386589 INFO  (Thread-4231) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1386589 INFO  (Thread-4231) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1386591 ERROR (Thread-4231) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1386689 INFO  (SUITE-TimeRoutedAliasUpdateProcessorTest-seed#[23A4129031B5ED54]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:44473
   [junit4]   2> 1386691 INFO  (zkConnectionManagerCallback-4325-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1386692 INFO  (jetty-launcher-4322-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1386692 INFO  (jetty-launcher-4322-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1386693 INFO  (jetty-launcher-4322-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@557b7916{/solr,null,AVAILABLE}
   [junit4]   2> 1386693 INFO  (jetty-launcher-4322-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2765b00e{/solr,null,AVAILABLE}
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3847b0f1{HTTP/1.1,[http/1.1]}{127.0.0.1:33389}
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-1) [    ] o.e.j.s.Server Started @1388698ms
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@69b33752{HTTP/1.1,[http/1.1]}{127.0.0.1:34901}
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33389}
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-2) [    ] o.e.j.s.Server Started @1388698ms
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34901}
   [junit4]   2> 1386695 ERROR (jetty-launcher-4322-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1386695 ERROR (jetty-launcher-4322-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T02:14:48.396566Z
   [junit4]   2> 1386695 INFO  (jetty-launcher-4322-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T02:14:48.396587Z
   [junit4]   2> 1386696 INFO  (zkConnectionManagerCallback-4329-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1386696 INFO  (zkConnectionManagerCallback-4328-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1386696 INFO  (jetty-launcher-4322-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1386696 INFO  (jetty-launcher-4322-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1386699 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160ed4c4ae30001, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1386700 INFO  (jetty-launcher-4322-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44473/solr
   [junit4]   2> 1386700 INFO  (jetty-launcher-4322-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44473/solr
   [junit4]   2> 1386700 INFO  (zkConnectionManagerCallback-4335-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1386701 INFO  (zkConnectionManagerCallback-4337-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1386701 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160ed4c4ae30004, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1386701 INFO  (zkConnectionManagerCallback-4340-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1386701 INFO  (zkConnectionManagerCallback-4341-thread-1-processing-n:127.0.0.1:33389_solr) [n:127.0.0.1:33389_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1386731 INFO  (jetty-launcher-4322-thread-2) [n:127.0.0.1:34901_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1386731 INFO  (jetty-launcher-4322-thread-1) [n:127.0.0.1:33389_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1386731 INFO  (jetty-launcher-4322-thread-2) [n:127.0.0.1:34901_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34901_solr
   [junit4]   2> 1386731 INFO  (jetty-launcher-4322-thread-1) [n:127.0.0.1:33389_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33389_solr
   [junit4]   2> 1386732 INFO  (jetty-launcher-4322-thread-2) [n:127.0.0.1:34901_solr    ] o.a.s.c.Overseer Overseer (id=99340103731838981-127.0.0.1:34901_solr-n_0000000000) starting
   [junit4]   2> 1386732 INFO  (zkCallback-4339-thread-1-processing-n:127.0.0.1:33389_solr) [n:127.0.0.1:33389_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1386732 INFO  (zkCallback-4338-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1386735 INFO  (jetty-launcher-4322-thread-2) [n:127.0.0.1:34901_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34901_solr
   [junit4]   2> 1386736 INFO  (zkCallback-4338-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1386736 INFO  (zkCallback-4339-thread-1-processing-n:127.0.0.1:33389_solr) [n:127.0.0.1:33389_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1386769 INFO  (jetty-launcher-4322-thread-1) [n:127.0.0.1:33389_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33389.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70bec0a9
   [junit4]   2> 1386771 INFO  (jetty-launcher-4322-thread-2) [n:127.0.0.1:34901_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34901.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70bec0a9
   [junit4]   2> 1386775 INFO  (jetty-launcher-4322-thread-2) [n:127.0.0.1:34901_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34901.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70bec0a9
   [junit4]   2> 1386775 INFO  (jetty-launcher-4322-thread-2) [n:127.0.0.1:34901_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34901.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70bec0a9
   [junit4]   2> 1386776 INFO  (jetty-launcher-4322-thread-2) [n:127.0.0.1:34901_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/.
   [junit4]   2> 1386777 INFO  (jetty-launcher-4322-thread-1) [n:127.0.0.1:33389_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33389.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70bec0a9
   [junit4]   2> 1386778 INFO  (jetty-launcher-4322-thread-1) [n:127.0.0.1:33389_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33389.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70bec0a9
   [junit4]   2> 1386779 INFO  (jetty-launcher-4322-thread-1) [n:127.0.0.1:33389_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node1/.
   [junit4]   2> 1386862 INFO  (zkConnectionManagerCallback-4347-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1386866 INFO  (qtp2085154506-15779) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1386866 INFO  (qtp2085154506-15779) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1386871 INFO  (TEST-TimeRoutedAliasUpdateProcessorTest.test-seed#[23A4129031B5ED54]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 1386872 INFO  (qtp2085154506-15779) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1386873 INFO  (qtp2085154506-15779) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1386873 INFO  (qtp2085154506-15781) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1386873 INFO  (qtp2085154506-15781) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1386874 INFO  (qtp2085154506-15771) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1386874 INFO  (qtp2085154506-15771) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1386874 INFO  (qtp2085154506-15769) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1386874 INFO  (qtp2085154506-15769) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1386874 INFO  (qtp2085154506-15781) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1386875 INFO  (qtp2085154506-15781) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1386875 INFO  (qtp2085154506-15779) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&name=timeConfig&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1386876 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.CreateCollectionCmd Create collection timeConfig
   [junit4]   2> 1386876 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.CreateCollectionCmd Only _default config set found, using it.
   [junit4]   2> 1386876 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/timeConfig/protwords.txt
   [junit4]   2> 1386877 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/timeConfig/managed-schema
   [junit4]   2> 1386877 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/timeConfig/solrconfig.xml
   [junit4]   2> 1386878 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/timeConfig/synonyms.txt
   [junit4]   2> 1386878 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/timeConfig/stopwords.txt
   [junit4]   2> 1386879 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/timeConfig/lang/contractions_it.txt
   [junit4]   2> 1386879 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/timeConfig/lang/stemdict_nl.txt
   [junit4]   2> 1386880 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/timeConfig/lang/stopwords_hy.txt
   [junit4]   2> 1386880 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/timeConfig/lang/stopwords_no.txt
   [junit4]   2> 1386881 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/timeConfig/lang/contractions_ca.txt
   [junit4]   2> 1386881 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/timeConfig/lang/stopwords_id.txt
   [junit4]   2> 1386882 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/timeConfig/lang/stopwords_ga.txt
   [junit4]   2> 1386882 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/timeConfig/lang/stopwords_hi.txt
   [junit4]   2> 1386883 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/timeConfig/lang/stopwords_da.txt
   [junit4]   2> 1386883 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/timeConfig/lang/stopwords_ja.txt
   [junit4]   2> 1386884 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/timeConfig/lang/stopwords_pt.txt
   [junit4]   2> 1386884 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/timeConfig/lang/stopwords_hu.txt
   [junit4]   2> 1386885 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/timeConfig/lang/stopwords_el.txt
   [junit4]   2> 1386885 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/timeConfig/lang/stopwords_ru.txt
   [junit4]   2> 1386886 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/timeConfig/lang/stopwords_tr.txt
   [junit4]   2> 1386886 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/timeConfig/lang/stopwords_ar.txt
   [junit4]   2> 1386887 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/timeConfig/lang/userdict_ja.txt
   [junit4]   2> 1386887 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/timeConfig/lang/stopwords_eu.txt
   [junit4]   2> 1386888 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/timeConfig/lang/stopwords_it.txt
   [junit4]   2> 1386888 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/timeConfig/lang/stopwords_cz.txt
   [junit4]   2> 1386889 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/timeConfig/lang/stoptags_ja.txt
   [junit4]   2> 1386889 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/timeConfig/lang/contractions_fr.txt
   [junit4]   2> 1386890 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/timeConfig/lang/stopwords_de.txt
   [junit4]   2> 1386890 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/timeConfig/lang/stopwords_fa.txt
   [junit4]   2> 1386891 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/timeConfig/lang/contractions_ga.txt
   [junit4]   2> 1386891 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/timeConfig/lang/stopwords_ca.txt
   [junit4]   2> 1386892 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/timeConfig/lang/stopwords_nl.txt
   [junit4]   2> 1386892 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/timeConfig/lang/stopwords_bg.txt
   [junit4]   2> 1386893 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/timeConfig/lang/stopwords_lv.txt
   [junit4]   2> 1386893 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/timeConfig/lang/stopwords_en.txt
   [junit4]   2> 1386894 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/timeConfig/lang/stopwords_es.txt
   [junit4]   2> 1386894 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/timeConfig/lang/stopwords_th.txt
   [junit4]   2> 1386894 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/timeConfig/lang/stopwords_ro.txt
   [junit4]   2> 1386895 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/timeConfig/lang/stopwords_fr.txt
   [junit4]   2> 1386896 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/timeConfig/lang/stopwords_sv.txt
   [junit4]   2> 1386896 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/timeConfig/lang/stopwords_fi.txt
   [junit4]   2> 1386897 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/timeConfig/lang/hyphenations_ga.txt
   [junit4]   2> 1386897 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/timeConfig/lang/stopwords_gl.txt
   [junit4]   2> 1386898 INFO  (OverseerThreadFactory-4385-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/timeConfig/params.json
   [junit4]   2> 1387001 INFO  (OverseerStateUpdate-99340103731838981-127.0.0.1:34901_solr-n_0000000000) [n:127.0.0.1:34901_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"timeConfig",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"timeConfig_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34901/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 1387203 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=timeConfig&newCollection=true&name=timeConfig_shard1_replica_n1&action=CREATE&numShards=1&collection=timeConfig&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1387203 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1387305 INFO  (zkCallback-4338-thread-1-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1387305 INFO  (zkCallback-4338-thread-2-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1388209 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
   [junit4]   2> 1388209 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 1388209 WARN  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/extraction/lib
   [junit4]   2> 1388209 WARN  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 1388209 WARN  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/clustering/lib
   [junit4]   2> 1388210 WARN  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 1388210 WARN  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/langid/lib
   [junit4]   2> 1388210 WARN  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 1388210 WARN  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/velocity/lib
   [junit4]   2> 1388210 WARN  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 1388215 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1388225 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.IndexSchema [timeConfig_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 1388294 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 1388304 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'timeConfig_shard1_replica_n1' using configuration from collection timeConfig, trusted=true
   [junit4]   2> 1388305 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34901.solr.core.timeConfig.shard1.replica_n1' (registry 'solr.core.timeConfig.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70bec0a9
   [junit4]   2> 1388305 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1388305 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [[timeConfig_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/./timeConfig_shard1_replica_n1/data/]
   [junit4]   2> 1388306 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 1388337 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1388338 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1388338 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
   [junit4]   2> 1388338 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1388339 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@39f3a3a6[timeConfig_shard1_replica_n1] main]
   [junit4]   2> 1388340 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/timeConfig
   [junit4]   2> 1388340 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/timeConfig
   [junit4]   2> 1388340 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/timeConfig/managed-schema
   [junit4]   2> 1388340 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1388341 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 1388341 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 1388342 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1388342 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589441661546528768
   [junit4]   2> 1388342 INFO  (searcherExecutor-4390-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@39f3a3a6[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1388342 INFO  (searcherExecutor-4390-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 1388342 INFO  (searcherExecutor-4390-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 1388343 INFO  (searcherExecutor-4390-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [timeConfig_shard1_replica_n1] Registered new searcher Searcher@39f3a3a6[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1388344 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1388344 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1388344 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34901/solr/timeConfig_shard1_replica_n1/
   [junit4]   2> 1388344 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1388344 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:34901/solr/timeConfig_shard1_replica_n1/ has no replicas
   [junit4]   2> 1388344 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1388345 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34901/solr/timeConfig_shard1_replica_n1/ shard1
   [junit4]   2> 1388446 INFO  (zkCallback-4338-thread-2-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1388446 INFO  (zkCallback-4338-thread-3-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1388496 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1388557 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=timeConfig&newCollection=true&name=timeConfig_shard1_replica_n1&action=CREATE&numShards=1&collection=timeConfig&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1354
   [junit4]   2> 1388559 INFO  (qtp2085154506-15779) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1388598 INFO  (zkCallback-4338-thread-3-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1388598 INFO  (zkCallback-4338-thread-2-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/timeConfig/state.json] for collection [timeConfig] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1388876 INFO  (OverseerCollectionConfigSetProcessor-99340103731838981-127.0.0.1:34901_solr-n_0000000000) [n:127.0.0.1:34901_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1389559 INFO  (qtp2085154506-15779) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&name=timeConfig&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=2684
   [junit4]   2> 1389560 INFO  (qtp2085154506-15773) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1389561 INFO  (qtp2085154506-15773) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1389564 INFO  (qtp1278323321-15782) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Executed config commands successfully and persisted to ZK [{"set-user-property":{"timePartitionAliasName":"myalias"}}, {"set-user-property":{"update.autoCreateFields":false}}, {"add-updateprocessor":{
   [junit4]   2>     "name":"tolerant",
   [junit4]   2>     "class":"solr.TolerantUpdateProcessorFactory"}}, {"add-updateprocessor":{
   [junit4]   2>     "name":"inc",
   [junit4]   2>     "class":"org.apache.solr.update.processor.TimeRoutedAliasUpdateProcessorTest$IncrementURPFactory",
   [junit4]   2>     "fieldName":"integer_i"}}]
   [junit4]   2> 1389564 INFO  (qtp1278323321-15782) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Waiting up to 30 secs for 1 replicas to set the property overlay to be of version 0 for collection timeConfig
   [junit4]   2> 1389564 INFO  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrCore config update listener called for core timeConfig_shard1_replica_n1
   [junit4]   2> 1389564 INFO  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrCore core reload timeConfig_shard1_replica_n1
   [junit4]   2> 1389565 INFO  (solrHandlerExecutor-4395-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 1389569 INFO  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
   [junit4]   2> 1389569 INFO  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 1389569 WARN  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/extraction/lib
   [junit4]   2> 1389570 WARN  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 1389570 WARN  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/clustering/lib
   [junit4]   2> 1389570 WARN  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 1389570 WARN  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/langid/lib
   [junit4]   2> 1389570 WARN  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 1389570 WARN  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../contrib/velocity/lib
   [junit4]   2> 1389570 WARN  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1/../../../../dist
   [junit4]   2> 1389576 INFO  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1389587 INFO  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.s.IndexSchema [timeConfig_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 1389659 INFO  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 1389666 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 1389666 INFO  (qtp1278323321-15778) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.S.Request [timeConfig_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1389666 INFO  (SolrConfigHandler-refreshconf) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 1389666 INFO  (solrHandlerExecutor-4395-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:34901/solr/timeConfig_shard1_replica_n1/ for prop overlay   after 1 attempts
   [junit4]   2> 1389666 INFO  (solrHandlerExecutor-4395-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 1389670 INFO  (Thread-4250) [n:127.0.0.1:34901_solr    ] o.a.s.c.CoreContainer Reloading SolrCore 'timeConfig_shard1_replica_n1' using configuration from collection timeConfig
   [junit4]   2> 1389682 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34901.solr.core.timeConfig.shard1.replica_n1' (registry 'solr.core.timeConfig.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70bec0a9
   [junit4]   2> 1389682 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [[timeConfig_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/timeConfig_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.update.processor.TimeRoutedAliasUpdateProcessorTest_23A4129031B5ED54-001/tempDir-001/node2/./timeConfig_shard1_replica_n1/data/]
   [junit4]   2> 1389684 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 1389713 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
   [junit4]   2> 1389713 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1389714 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1e9165d6[timeConfig_shard1_replica_n1] main]
   [junit4]   2> 1389714 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/timeConfig
   [junit4]   2> 1389714 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/timeConfig
   [junit4]   2> 1389715 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/timeConfig/managed-schema
   [junit4]   2> 1389715 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1389715 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 1389715 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 1389715 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1389716 INFO  (searcherExecutor-4396-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@1e9165d6[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1389716 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589441662987272192
   [junit4]   2> 1389716 INFO  (searcherExecutor-4396-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 1389716 INFO  (searcherExecutor-4396-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 1389717 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1389718 INFO  (searcherExecutor-4396-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [timeConfig_shard1_replica_n1] Registered new searcher Searcher@1e9165d6[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1389718 INFO  (Thread-4250) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3a08bc97[timeConfig_shard1_replica_n1] main]
   [junit4]   2> 1389718 INFO  (searcherExecutor-4396-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@3a08bc97[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1389718 INFO  (searcherExecutor-4396-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 1389720 INFO  (searcherExecutor-4396-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [timeConfig_shard1_replica_n1] Registered new searcher Searcher@3a08bc97[timeConfig_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1389767 INFO  (qtp1278323321-15770) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler I already have the expected version 0 of config
   [junit4]   2> 1389767 INFO  (qtp1278323321-15770) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler isStale false , resourceloader org.apache.solr.cloud.ZkSolrResourceLoader
   [junit4]   2> 1389767 INFO  (qtp1278323321-15770) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.S.Request [timeConfig_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1389767 INFO  (qtp1278323321-15782) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Took 203.0ms to set the property overlay to be of version 0 for collection timeConfig
   [junit4]   2> 1389767 INFO  (qtp1278323321-15782) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.S.Request [timeConfig_shard1_replica_n1]  webapp=/solr path=/config params={wt=javabin&version=2} status=0 QTime=204
   [junit4]   2> 1389767 INFO  (qtp1278323321-15782) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.SolrCore [timeConfig_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@38668a3b
   [junit4]   2> 1389767 INFO  (qtp1278323321-15782) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.timeConfig.shard1.replica_n1, tag=946244155
   [junit4]   2> 1389767 INFO  (qtp1278323321-15782) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4e823126: rootName = solr_34901, domain = solr.core.timeConfig.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.timeConfig.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@4e5ec82e
   [junit4]   2> 1389775 INFO  (qtp1278323321-15782) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.timeConfig.shard1.leader, tag=946244155
   [junit4]   2> 1389776 INFO  (qtp2085154506-15769) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1389777 INFO  (qtp2085154506-15769) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1389778 INFO  (qtp1278323321-15768) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.ZkController Persisted config data to node /configs/timeConfig/params.json
   [junit4]   2> 1389779 INFO  (qtp1278323321-15768) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Waiting up to 30 secs for 1 replicas to set the property params to be of version 1 for collection timeConfig
   [junit4]   2> 1389779 INFO  (Thread-4251) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrCore config update listener called for core timeConfig_shard1_replica_n1
   [junit4]   2> 1389779 INFO  (Thread-4251) [n:127.0.0.1:34901_solr    ] o.a.s.c.RequestParams conf resource params.json loaded . version : 1
   [junit4]   2> 1389779 INFO  (Thread-4251) [n:127.0.0.1:34901_solr    ] o.a.s.c.RequestParams request params refreshed to version 1
   [junit4]   2> 1389780 INFO  (solrHandlerExecutor-4400-thread-1-processing-n:127.0.0.1:34901_solr x:timeConfig_shard1_replica_n1 s:shard1 c:timeConfig r:core_node2) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 1389880 INFO  (qtp1278323321-15770) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler I already have the expected version 1 of params
   [junit4]   2> 1389881 INFO  (qtp1278323321-15770) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler isStale false , resourceloader org.apache.solr.cloud.ZkSolrResourceLoader
   [junit4]   2> 1389881 INFO  (qtp1278323321-15770) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.S.Request [timeConfig_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={params=1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1389881 INFO  (qtp1278323321-15768) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.h.SolrConfigHandler Took 102.0ms to set the property params to be of version 1 for collection timeConfig
   [junit4]   2> 1389881 INFO  (qtp1278323321-15768) [n:127.0.0.1:34901_solr c:timeConfig s:shard1 r:core_node2 x:timeConfig_shard1_replica_n1] o.a.s.c.S.Request [timeConfig_shard1_replica_n1]  webapp=/solr path=/config/params params={wt=javabin&version=2} status=0 QTime=103
   [junit4]   2> 1389881 INFO  (qtp2085154506-15779) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1389882 INFO  (qtp2085154506-15779) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1389882 INFO  (qtp2085154506-15771) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1389883 INFO  (qtp2085154506-15771) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1389883 INFO  (qtp2085154506-15773) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=timeConfig&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1389884 INFO  (OverseerThreadFactory-4385-thread-2-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 1389884 INFO  (qtp1278323321-15780) [n:127.0.0.1:34901_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.timeConfig.shard1.replica_n1, tag=null
   [junit4]   2> 1389884 INFO  (qtp1278323321-15780) [n:127.0.0.1:34901_solr    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@374089dc: rootName = solr_34901, domain = solr.core.timeConfig.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.timeConfig.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@4e5ec82e
   [junit4]   2> 1389892 INFO  (qtp1278323321-15780) [n:127.0.0.1:34901_solr    ] o.a.s.c.SolrCore [timeConfig_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@53824c16
   [junit4]   2> 1389892 INFO  (qtp1278323321-15780) [n:127.0.0.1:34901_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.timeConfig.shard1.replica_n1, tag=1401048086
   [junit4]   2> 1389892 INFO  (qtp1278323321-15780) [n:127.0.0.1:34901_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.timeConfig.shard1.leader, tag=1401048086
   [junit4]   2> 1389894 INFO  (qtp1278323321-15780) [n:127.0.0.1:34901_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=timeConfig_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=9
   [junit4]   2> 1390597 INFO  (qtp2085154506-15773) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=timeConfig&action=DELETE&wt=javabin&version=2} status=0 QTime=713
   [junit4]   2> 1390597 INFO  (qtp2085154506-15769) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1390597 INFO  (qtp2085154506-15769) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1390597 INFO  (qtp2085154506-15779) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1390598 INFO  (qtp2085154506-15779) [n:127.0.0.1:33389_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1390598 INFO  (qtp2085154506-15781) [n:127.0.0.1:33389_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&property.timePartitionAliasName=myalias&collection.configName=timeConfig&maxShardsPerNode=2&name=myalias_2017-10-23&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1390599 INFO  (OverseerThreadFactory-4385-thread-3-processing-n:127.0.0.1:34901_solr) [n:127.0.0.1:34901_solr    ] o.a.s.c.CreateCollectionCmd Create collection myalias_2017-10-23
   [junit4]   2> 1390599 INFO  (OverseerCollectionConfigSetProcessor-99340103731838981-127.0.0.1:34901_solr-n_0000000000) [n:127.0.0.1:34901_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1390803 INFO  (OverseerStateUpdate-99340103731838981-127.0.0.1:34901_solr-n_0000000000) [n:127.0.0.1:34901_solr    ] o.a.s.c.o.SliceMutator create

[...truncated too long message...]

0.0.1:37285_solr) [n:127.0.0.1:37285_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 144612 INFO  (jetty-closer-1183-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@796bb3cf{/solr,null,UNAVAILABLE}
   [junit4]   2> 144618 INFO  (coreCloseExecutor-748-thread-1) [n:127.0.0.1:46183_solr c:collection1_collection s:shard1 r:core_node3 x:collection1_collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1_collection.shard1.leader, tag=1622269974
   [junit4]   2> 144618 INFO  (coreCloseExecutor-749-thread-1) [n:127.0.0.1:37285_solr c:collection1_collection s:shard2 r:core_node4 x:collection1_collection_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1_collection.shard2.leader, tag=1767520899
   [junit4]   2> 144619 INFO  (jetty-closer-1183-thread-4) [    ] o.a.s.c.Overseer Overseer (id=99340252794060810-127.0.0.1:46183_solr-n_0000000000) closing
   [junit4]   2> 144619 INFO  (OverseerStateUpdate-99340252794060810-127.0.0.1:46183_solr-n_0000000000) [n:127.0.0.1:46183_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:46183_solr
   [junit4]   2> 144619 WARN  (OverseerAutoScalingTriggerThread-99340252794060810-127.0.0.1:46183_solr-n_0000000000) [n:127.0.0.1:46183_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 144620 INFO  (jetty-closer-1183-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@539ce93c{/solr,null,UNAVAILABLE}
   [junit4]   2> 144620 INFO  (jetty-closer-1183-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6bbd69bb{/solr,null,UNAVAILABLE}
   [junit4]   2> 146110 WARN  (zkCallback-1216-thread-1-processing-n:127.0.0.1:35333_solr) [n:127.0.0.1:35333_solr    ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:37285_solr
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:37285_solr
   [junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:364)
   [junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:364)
   [junit4]   2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:879)
   [junit4]   2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:704)
   [junit4]   2> at java.base/java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4717)
   [junit4]   2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:703)
   [junit4]   2> at org.apache.solr.common.cloud.ZkStateReader.access$900(ZkStateReader.java:72)
   [junit4]   2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1090)
   [junit4]   2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1085)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:268)
   [junit4]   2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
   [junit4]   2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]   2> at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 146111 INFO  (jetty-closer-1183-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3762cc32{/solr,null,UNAVAILABLE}
   [junit4]   2> 146111 ERROR (SUITE-StreamExpressionTest-seed#[5E9A2644272FE770]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 146112 INFO  (SUITE-StreamExpressionTest-seed#[5E9A2644272FE770]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35049 35049
   [junit4]   2> 147394 INFO  (Thread-490) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35049 35049
   [junit4]   2> 147394 WARN  (Thread-490) [    ] o.a.s.c.ZkTestServer Watch limit violations:
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2>
   [junit4]   2> 78 /solr/aliases.json
   [junit4]   2> 78 /solr/clusterprops.json
   [junit4]   2> 11 /solr/configs/conf
   [junit4]   2> 4 /solr/security.json
   [junit4]   2>
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2>
   [junit4]   2> 78 /solr/clusterstate.json
   [junit4]   2> 20 /solr/collections/parallelDestinationCollection/state.json
   [junit4]   2> 20 /solr/collections/parallelDestinationCollection1/state.json
   [junit4]   2> 20 /solr/collections/destinationCollection/state.json
   [junit4]   2> 10 /solr/collections/mainCorpus1/state.json
   [junit4]   2> 10 /solr/collections/destination/state.json
   [junit4]   2> 10 /solr/collections/destination1/state.json
   [junit4]   2> 10 /solr/collections/collection1_collection/state.json
   [junit4]   2> 10 /solr/collections/workQueue1/state.json
   [junit4]   2> 10 /solr/collections/workQueue/state.json
   [junit4]   2> 10 /solr/collections/mainCorpus/state.json
   [junit4]   2> 2 /solr/overseer_elect/election/99340252794060810-127.0.0.1:46183_solr-n_0000000000
   [junit4]   2>
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2>
   [junit4]   2> 78 /solr/live_nodes
   [junit4]   2> 78 /solr/collections
   [junit4]   2>
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.io.stream.StreamExpressionTest_5E9A2644272FE770-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {expr_s=PostingsFormat(name=LuceneVarGapFixedInterval), join2_s=Lucene50(blocksize=128), multiDefault=Lucene50(blocksize=128), subject=Lucene50(blocksize=128), price_f=Lucene50(blocksize=128), a1_s=FSTOrd50, a_f=FSTOrd50, intDefault=FSTOrd50, join1_i=PostingsFormat(name=LuceneVarGapFixedInterval), a2_s=PostingsFormat(name=LuceneVarGapFixedInterval), a_i=BlockTreeOrds(blocksize=128), join3_i=BlockTreeOrds(blocksize=128), test_i=Lucene50(blocksize=128), field_i=Lucene50(blocksize=128), level1_s=PostingsFormat(name=LuceneVarGapFixedInterval), body_t=BlockTreeOrds(blocksize=128), s_multi=PostingsFormat(name=LuceneVarGapFixedInterval), level2_s=FSTOrd50, col_s=FSTOrd50, a_ss=Lucene50(blocksize=128), a_s=PostingsFormat(name=LuceneVarGapFixedInterval), a_t=Lucene50(blocksize=128), id=BlockTreeOrds(blocksize=128), text=PostingsFormat(name=LuceneVarGapFixedInterval), timestamp=Lucene50(blocksize=128), i_multi=BlockTreeOrds(blocksize=128), b_ls=FSTOrd50, test_dt=PostingsFormat(name=LuceneVarGapFixedInterval), test_t=BlockTreeOrds(blocksize=128), ident_s=FSTOrd50, order_i=Lucene50(blocksize=128), _version_=FSTOrd50, side_s=BlockTreeOrds(blocksize=128), miles_i=FSTOrd50}, docValues:{expr_s=DocValuesFormat(name=Memory), join2_s=DocValuesFormat(name=Lucene70), multiDefault=DocValuesFormat(name=Lucene70), price_f=DocValuesFormat(name=Lucene70), a1_s=DocValuesFormat(name=Direct), a_f=DocValuesFormat(name=Direct), intDefault=DocValuesFormat(name=Direct), join1_i=DocValuesFormat(name=Memory), a2_s=DocValuesFormat(name=Memory), a_i=DocValuesFormat(name=Lucene70), join3_i=DocValuesFormat(name=Lucene70), test_i=DocValuesFormat(name=Lucene70), field_i=DocValuesFormat(name=Lucene70), level1_s=DocValuesFormat(name=Memory), s_multi=DocValuesFormat(name=Memory), level2_s=DocValuesFormat(name=Direct), col_s=DocValuesFormat(name=Direct), a_ss=DocValuesFormat(name=Lucene70), a_s=DocValuesFormat(name=Memory), id=DocValuesFormat(name=Lucene70), timestamp=DocValuesFormat(name=Lucene70), i_multi=DocValuesFormat(name=Lucene70), b_ls=DocValuesFormat(name=Direct), test_dt=DocValuesFormat(name=Memory), ident_s=DocValuesFormat(name=Direct), order_i=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Direct), side_s=DocValuesFormat(name=Lucene70), miles_i=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=1989, maxMBSortInHeap=6.692872295858714, sim=RandomSimilarity(queryNorm=true): {}, locale=ar-DJ, timezone=America/Grenada
   [junit4]   2> NOTE: Linux 4.13.0-26-generic amd64/Oracle Corporation 10-ea (64-bit)/cpus=8,threads=1,free=276444272,total=504889344
   [junit4]   2> NOTE: All tests run in this JVM: [TestNamedListCodec, StreamingTest, LargeVolumeBinaryJettyTest, HttpSolrClientConPoolTest, SchemaTest, TestXMLEscaping, SolrExampleStreamingTest, NaturalLogEvaluatorTest, AnlysisResponseBaseTest, JdbcTest, EmpiricalDistributionEvaluatorTest, LargeVolumeEmbeddedTest, ArcSineEvaluatorTest, TestZkConfigManager, TestV1toV2ApiMapper, HyperbolicTangentEvaluatorTest, TestToleratedUpdateError, GreaterThanEvaluatorTest, NotEvaluatorTest, ShardParamsTest, TestPathTrie, TestClusteringResponse, ConcurrentUpdateSolrClientBuilderTest, HttpSolrClientSSLAuthConPoolTest, GraphExpressionTest, StreamExpressionTest]
   [junit4] Completed [146/146 (1!)] on J0 in 76.06s, 149 tests, 1 failure, 9 skipped <<< FAILURES!

[...truncated 39952 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_144) - Build # 1171 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1171/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseSerialGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:     1) Thread[id=35873, name=jetty-launcher-9486-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)    2) Thread[id=35869, name=jetty-launcher-9486-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
   1) Thread[id=35873, name=jetty-launcher-9486-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   2) Thread[id=35869, name=jetty-launcher-9486-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
        at __randomizedtesting.SeedInfo.seed([B98C602AD2D25541]:0)


FAILED:  org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig

Error Message:
expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}>

Stack Trace:
java.lang.AssertionError: expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}>
        at __randomizedtesting.SeedInfo.seed([B98C602AD2D25541:86046382C584A5A6]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig(TestClusterStateProvider.java:214)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13606 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
   [junit4]   2> 3179787 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[B98C602AD2D25541]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_B98C602AD2D25541-001/init-core-data-001
   [junit4]   2> 3179788 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[B98C602AD2D25541]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 3179789 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[B98C602AD2D25541]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 3179799 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[B98C602AD2D25541]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_B98C602AD2D25541-001/tempDir-001
   [junit4]   2> 3179799 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[B98C602AD2D25541]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 3179800 INFO  (Thread-7348) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3179800 INFO  (Thread-7348) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 3179801 ERROR (Thread-7348) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3179899 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[B98C602AD2D25541]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:36319
   [junit4]   2> 3179902 INFO  (zkConnectionManagerCallback-9489-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3179909 INFO  (jetty-launcher-9486-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 3179909 INFO  (jetty-launcher-9486-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 3179911 INFO  (jetty-launcher-9486-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5ceaa771{/solr,null,AVAILABLE}
   [junit4]   2> 3179915 INFO  (jetty-launcher-9486-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@62b2b242{SSL,[ssl, http/1.1]}{127.0.0.1:32923}
   [junit4]   2> 3179915 INFO  (jetty-launcher-9486-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2f39c3c1{/solr,null,AVAILABLE}
   [junit4]   2> 3179916 INFO  (jetty-launcher-9486-thread-2) [    ] o.e.j.s.Server Started @3181309ms
   [junit4]   2> 3179916 INFO  (jetty-launcher-9486-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=32923}
   [junit4]   2> 3179916 ERROR (jetty-launcher-9486-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3179916 INFO  (jetty-launcher-9486-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 3179916 INFO  (jetty-launcher-9486-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3179917 INFO  (jetty-launcher-9486-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3179917 INFO  (jetty-launcher-9486-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T07:17:19.482Z
   [junit4]   2> 3179921 INFO  (jetty-launcher-9486-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@45d17336{SSL,[ssl, http/1.1]}{127.0.0.1:36703}
   [junit4]   2> 3179921 INFO  (jetty-launcher-9486-thread-1) [    ] o.e.j.s.Server Started @3181314ms
   [junit4]   2> 3179922 INFO  (jetty-launcher-9486-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36703}
   [junit4]   2> 3179922 ERROR (jetty-launcher-9486-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 3179922 INFO  (jetty-launcher-9486-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 3179922 INFO  (jetty-launcher-9486-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 3179922 INFO  (jetty-launcher-9486-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 3179922 INFO  (jetty-launcher-9486-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T07:17:19.487Z
   [junit4]   2> 3179925 INFO  (zkConnectionManagerCallback-9491-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3179926 INFO  (jetty-launcher-9486-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3179926 INFO  (zkConnectionManagerCallback-9493-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3179926 INFO  (jetty-launcher-9486-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3179933 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160ee6141850001, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3179937 INFO  (jetty-launcher-9486-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36319/solr
   [junit4]   2> 3179938 INFO  (jetty-launcher-9486-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36319/solr
   [junit4]   2> 3179941 INFO  (zkConnectionManagerCallback-9498-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3179942 INFO  (zkConnectionManagerCallback-9501-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3179944 INFO  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3179944 INFO  (zkConnectionManagerCallback-9505-thread-1-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3179971 INFO  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3179971 INFO  (jetty-launcher-9486-thread-2) [n:127.0.0.1:32923_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3179972 INFO  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36703_solr
   [junit4]   2> 3179972 INFO  (jetty-launcher-9486-thread-2) [n:127.0.0.1:32923_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32923_solr
   [junit4]   2> 3179972 INFO  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.c.Overseer Overseer (id=99341293280624646-127.0.0.1:36703_solr-n_0000000000) starting
   [junit4]   2> 3179972 INFO  (zkCallback-9502-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3179972 INFO  (zkCallback-9504-thread-1-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3179975 INFO  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36703_solr
   [junit4]   2> 3179975 INFO  (zkCallback-9504-thread-1-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3179975 INFO  (zkCallback-9502-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3179987 INFO  (jetty-launcher-9486-thread-2) [n:127.0.0.1:32923_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 3179987 WARN  (jetty-launcher-9486-thread-2) [n:127.0.0.1:32923_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 3179987 INFO  (jetty-launcher-9486-thread-2) [n:127.0.0.1:32923_solr    ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
   [junit4]   2> 3179988 INFO  (jetty-launcher-9486-thread-2) [n:127.0.0.1:32923_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 3179989 INFO  (jetty-launcher-9486-thread-2-EventThread) [n:127.0.0.1:32923_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 3179993 INFO  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 3179993 WARN  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 3179993 INFO  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
   [junit4]   2> 3179994 INFO  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 3179995 INFO  (jetty-launcher-9486-thread-1-EventThread) [n:127.0.0.1:36703_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 3180002 WARN  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 3180022 INFO  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36703.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6debc058
   [junit4]   2> 3180027 INFO  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36703.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6debc058
   [junit4]   2> 3180027 INFO  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36703.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6debc058
   [junit4]   2> 3180028 INFO  (jetty-launcher-9486-thread-1) [n:127.0.0.1:36703_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_B98C602AD2D25541-001/tempDir-001/node1/.
   [junit4]   2> 3180995 WARN  (jetty-launcher-9486-thread-2) [n:127.0.0.1:32923_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 3181011 INFO  (jetty-launcher-9486-thread-2) [n:127.0.0.1:32923_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32923.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6debc058
   [junit4]   2> 3181015 INFO  (jetty-launcher-9486-thread-2) [n:127.0.0.1:32923_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32923.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6debc058
   [junit4]   2> 3181016 INFO  (jetty-launcher-9486-thread-2) [n:127.0.0.1:32923_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32923.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6debc058
   [junit4]   2> 3181016 INFO  (jetty-launcher-9486-thread-2) [n:127.0.0.1:32923_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_B98C602AD2D25541-001/tempDir-001/node2/.
   [junit4]   2> 3181031 INFO  (zkConnectionManagerCallback-9511-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3181044 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
   [junit4]   2> 3186164 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1515863840626&s=j/QPz1SPgdBP+Nl6FQjjTv9vV2A="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:20 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:20 GMT
   [junit4]   2> 3186165 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
   [junit4]   2> 3186229 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
   [junit4]   2> 3201248 WARN  (jetty-launcher-9486-thread-1-SendThread(127.0.0.1:36319)) [n:127.0.0.1:36703_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 20251ms for sessionid 0x160ee6141850008
   [junit4]   2> 3201248 WARN  (jetty-launcher-9486-thread-2-SendThread(127.0.0.1:36319)) [n:127.0.0.1:32923_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 20251ms for sessionid 0x160ee6141850007
   [junit4]   2> 3201248 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160ee6141850008, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3201248 WARN  (jetty-launcher-9486-thread-1-SendThread(127.0.0.1:36319)) [n:127.0.0.1:36703_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15085ms for sessionid 0x160ee6141850006
   [junit4]   2> 3201249 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160ee6141850007, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3201248 WARN  (jetty-launcher-9486-thread-2-SendThread(127.0.0.1:36319)) [n:127.0.0.1:32923_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 20230ms for sessionid 0x160ee6141850005
   [junit4]   2> 3201249 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160ee6141850006, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3201250 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160ee6141850005, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3201251 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=test&e=1515863845795&s=yULGBUnVqjvgUGt2zJw/6EBqP24="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:25 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:25 GMT
   [junit4]   2> 3201251 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
   [junit4]   2> 3201290 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
   [junit4]   2> 3201301 WARN  (qtp1202982081-35834) [    ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: ???bar???: no such user
   [junit4]   2> id: ???bar???: no such user
   [junit4]   2>
   [junit4]   2> 3201303 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=test&e=1515863860856&s=5oi1z14mUscYEMMTL59XOrpN8uk="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:40 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:40 GMT
   [junit4]   2> 3201304 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
   [junit4]   2> 3201337 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
   [junit4]   2> 3201343 INFO  (qtp1202982081-35835) [n:127.0.0.1:36703_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3201344 INFO  (qtp1202982081-35835) [n:127.0.0.1:36703_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3201344 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=test&e=1515863860902&s=Q0rgUfdAq9NuE0fWaaLdMZCWjrU="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:40 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:40 GMT
   [junit4]   2> 3201344 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
   [junit4]   2> 3201349 WARN  (zkConnectionManagerCallback-9505-thread-1-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@35458ccb name: ZooKeeperConnection Watcher:127.0.0.1:36319/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 3201349 INFO  (jetty-launcher-9486-thread-2-EventThread) [n:127.0.0.1:32923_solr    ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
   [junit4]   2> 3201351 WARN  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@303ac74 name: ZooKeeperConnection Watcher:127.0.0.1:36319/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 3201357 WARN  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 3201350 WARN  (zkConnectionManagerCallback-9505-thread-1-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 3201376 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
   [junit4]   2> 3201378 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=test&e=1515863860942&s=gCUXNjTdGbBoi/R6gG5nBZebMFw="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:40 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:40 GMT
   [junit4]   2> 3201378 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
   [junit4]   2> 3201395 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
   [junit4]   2> 3201396 INFO  (qtp1202982081-35833) [n:127.0.0.1:36703_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3201396 INFO  (qtp1202982081-35833) [n:127.0.0.1:36703_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3201396 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1515863860961&s=68EplzfhQPOBHHl2O4Xtdco/5Jk="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:40 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:40 GMT
   [junit4]   2> 3201396 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
   [junit4]   2> 3201418 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
   [junit4]   2> 3201423 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1515863860983&s=s35uuuXYdSzlA7Yq55S9XtdUzZ4="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:40 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:40 GMT
   [junit4]   2> 3201423 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
   [junit4]   2> 3201446 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
   [junit4]   2> 3201447 INFO  (zkConnectionManagerCallback-9514-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3201565 INFO  (zkConnectionManagerCallback-9517-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3201566 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[B98C602AD2D25541]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3201566 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[B98C602AD2D25541]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36319/solr ready
   [junit4]   2> 3201569 INFO  (qtp1202982081-35833) [n:127.0.0.1:36703_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3202616 WARN  (jetty-launcher-9486-thread-2-SendThread(127.0.0.1:36319)) [n:127.0.0.1:32923_solr    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x160ee6141850005 has expired
   [junit4]   2> 3202616 WARN  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@303ac74 name: ZooKeeperConnection Watcher:127.0.0.1:36319/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
   [junit4]   2> 3202616 WARN  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
   [junit4]   2> 3202616 INFO  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 3202616 WARN  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
   [junit4]   2> 3202617 INFO  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr-EventThread) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3202618 INFO  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
   [junit4]   2> 3202618 INFO  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration.
   [junit4]   2> 3202620 INFO  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 3202625 INFO  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32923_solr
   [junit4]   2> 3202626 INFO  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
   [junit4]   2> 3202626 INFO  (zkCallback-9502-thread-3-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3202626 INFO  (zkConnectionManagerCallback-9503-thread-1-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ConnectionManager zkClient Connected:true
   [junit4]   2> 3202626 INFO  (zkCallback-9516-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3202829 WARN  (jetty-launcher-9486-thread-2-SendThread(127.0.0.1:36319)) [n:127.0.0.1:32923_solr    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x160ee6141850007 has expired
   [junit4]   2> 3202893 WARN  (jetty-launcher-9486-thread-1-SendThread(127.0.0.1:36319)) [n:127.0.0.1:36703_solr    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x160ee6141850008 has expired
   [junit4]   2> 3202966 INFO  (zkConnectionManagerCallback-9505-thread-1-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 3202967 INFO  (OverseerThreadFactory-11638-thread-1-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.CreateCollectionCmd Create collection forwardingCollection
   [junit4]   2> 3203075 INFO  (OverseerStateUpdate-99341293280624646-127.0.0.1:36703_solr-n_0000000000) [n:127.0.0.1:36703_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"forwardingCollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"forwardingCollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36703/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 3203281 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 3203281 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 3203385 INFO  (zkCallback-9504-thread-2-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 3203385 INFO  (zkCallback-9504-thread-3-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 3204294 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 3204308 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
   [junit4]   2> 3204383 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 3204390 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
   [junit4]   2> 3204391 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36703.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6debc058
   [junit4]   2> 3204391 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 3204391 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_B98C602AD2D25541-001/tempDir-001/node1/forwardingCollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_B98C602AD2D25541-001/tempDir-001/node1/./forwardingCollection_shard1_replica_n1/data/]
   [junit4]   2> 3204392 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.22914029294788368]
   [junit4]   2> 3204446 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 3204446 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 3204446 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 3204447 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 3204447 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=0.5458984375, floorSegmentMB=0.8984375, forceMergeDeletesPctAllowed=23.585499052351192, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5531914664440669
   [junit4]   2> 3204447 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@bfab661[forwardingCollection_shard1_replica_n1] main]
   [junit4]   2> 3204449 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 3204499 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 3204592 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 3204592 INFO  (searcherExecutor-11643-thread-1-processing-n:127.0.0.1:36703_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 3204593 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589460718487339008
   [junit4]   2> 3204594 INFO  (searcherExecutor-11643-thread-1-processing-n:127.0.0.1:36703_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 3204594 INFO  (searcherExecutor-11643-thread-1-processing-n:127.0.0.1:36703_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 3204594 INFO  (searcherExecutor-11643-thread-1-processing-n:127.0.0.1:36703_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 3204594 INFO  (searcherExecutor-11643-thread-1-processing-n:127.0.0.1:36703_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 3204594 INFO  (searcherExecutor-11643-thread-1-processing-n:127.0.0.1:36703_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 3204594 INFO  (searcherExecutor-11643-thread-1-processing-n:127.0.0.1:36703_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 3204594 INFO  (searcherExecutor-11643-thread-1-processing-n:127.0.0.1:36703_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 3204594 INFO  (searcherExecutor-11643-thread-1-processing-n:127.0.0.1:36703_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 3204595 INFO  (searcherExecutor-11643-thread-1-processing-n:127.0.0.1:36703_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@bfab661[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3204596 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 3204597 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 3204597 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:36703/solr/forwardingCollection_shard1_replica_n1/
   [junit4]   2> 3204597 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 3204597 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:36703/solr/forwardingCollection_shard1_replica_n1/ has no replicas
   [junit4]   2> 3204597 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 3204598 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:36703/solr/forwardingCollection_shard1_replica_n1/ shard1
   [junit4]   2> 3204699 INFO  (zkCallback-9504-thread-2-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 3204699 INFO  (zkCallback-9504-thread-3-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 3204748 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 3204749 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1469
   [junit4]   2> 3204750 WARN  (httpShardExecutor-11634-thread-1-processing-n:127.0.0.1:36703_solr [https:////127.0.0.1:36703//solr] https:////127.0.0.1:36703//solr) [n:127.0.0.1:36703_solr    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1515863862845&s=o9ebD3Galf9Jk8HWnVW9LaPqhyc="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:42 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:42 GMT
   [junit4]   2> 3204752 INFO  (qtp1202982081-35833) [n:127.0.0.1:36703_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 3204849 INFO  (zkCallback-9504-thread-2-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 3204849 INFO  (zkCallback-9504-thread-3-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 3204968 INFO  (OverseerCollectionConfigSetProcessor-99341293280624646-127.0.0.1:36703_solr-n_0000000000) [n:127.0.0.1:36703_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 3205752 INFO  (qtp1202982081-35833) [n:127.0.0.1:36703_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=4183
   [junit4]   2> 3205753 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1515863861133&s=bfgoZWrJ1a7IK5hA89Jg80DHCww="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:41 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:41 GMT
   [junit4]   2> 3205754 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[B98C602AD2D25541]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
   [junit4]   2> 3205754 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[B98C602AD2D25541]) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
   [junit4]   2> 3205760 INFO  (qtp1202982081-35829) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 3205761 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1515863865323&s=UKK4lrJlxl7ktOjU0j4kLgufSpI="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:45 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:45 GMT
   [junit4]   2> 3205802 INFO  (qtp1202982081-35821) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 3205803 WARN  (qtp1994809941-35819) [n:127.0.0.1:32923_solr    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1515863865367&s=KDeN0UTR69jj8es0Qo3/pPBsl+0="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:45 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:45 GMT
   [junit4]   2> 3205803 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1515863865364&s=qa4hriKPc3MR7FV6/VkR3nVV8Sc="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:45 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:45 GMT
   [junit4]   2> 3205803 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1515863865367&s=KDeN0UTR69jj8es0Qo3/pPBsl+0="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:45 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:45 GMT
   [junit4]   2> 3205803 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
   [junit4]   2> 3205836 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
   [junit4]   2> 3205838 INFO  (qtp1202982081-35835) [n:127.0.0.1:36703_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 3205839 INFO  (qtp1202982081-35835) [n:127.0.0.1:36703_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 3205839 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=test&e=1515863865403&s=YI9Ie3br1Zs7Go/K6a+eEVuausk="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:45 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:45 GMT
   [junit4]   2> 3205839 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
   [junit4]   2> 3205877 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
   [junit4]   2> 3205881 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=test&e=1515863865443&s=DuiSHxQP2xIQH3nGIQZEveaBycA="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:45 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:45 GMT
   [junit4]   2> 3205881 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
   [junit4]   2> 3205918 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
   [junit4]   2> 3205918 INFO  (qtp1202982081-35833) [n:127.0.0.1:36703_solr    ] o.a.s.s.SolrDispatchFilter Error authenticating
   [junit4]   2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
   [junit4]   2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
   [junit4]   2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
   [junit4]   2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:449)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3205919 WARN  (qtp1202982081-35833) [n:127.0.0.1:36703_solr    ] o.e.j.s.ServletHandler /solr/admin/collections
   [junit4]   2> org.apache.solr.common.SolrException: Error during request authentication,
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:455)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
   [junit4]   2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
   [junit4]   2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
   [junit4]   2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:449)
   [junit4]   2> ... 29 more
   [junit4]   2> 3205921 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
   [junit4]   2> 3205956 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
   [junit4]   2> 3205959 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[B98C602AD2D25541]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=test&e=1515863865523&s=YXpp6xDoKLrsyZzEbz5ToFz1jzI="; Path=/; Domain=127.0.0.1; Expires=  , 13-   -2018 17:17:45 GMT; Secure; HttpOnly". Invalid 'expires' attribute: , 13- -2018 17:17:45 GMT
   [junit4]   2> 3205960 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[B98C602AD2D25541]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
   [junit4]   2> 3205961 INFO  (jetty-closer-9487-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@62b2b242{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 3205962 INFO  (jetty-closer-9487-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1600705306
   [junit4]   2> 3205962 INFO  (jetty-closer-9487-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 3205963 INFO  (jetty-closer-9487-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@f84472f: rootName = solr_32923, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@dfe67d9
   [junit4]   2> 3205963 INFO  (jetty-closer-9487-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@45d17336{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 3205963 INFO  (jetty-closer-9487-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=703755992
   [junit4]   2> 3205964 INFO  (jetty-closer-9487-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 3205964 INFO  (jetty-closer-9487-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3cd9143e: rootName = solr_36703, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@6cd63dab
   [junit4]   2> 3205968 INFO  (jetty-closer-9487-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 3205968 INFO  (jetty-closer-9487-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7fa4bb95: rootName = solr_32923, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@64447eef
   [junit4]   2> 3205970 INFO  (jetty-closer-9487-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 3205970 INFO  (jetty-closer-9487-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4358df81: rootName = solr_36703, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@64447eef
   [junit4]   2> 3205971 INFO  (jetty-closer-9487-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 3205971 INFO  (jetty-closer-9487-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@77291195: rootName = solr_32923, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@16cfa038
   [junit4]   2> 3205972 INFO  (jetty-closer-9487-thread-2) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:32923_solr
   [junit4]   2> 3205972 INFO  (jetty-closer-9487-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 3205972 INFO  (zkCallback-9504-thread-3-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 3205972 INFO  (zkCallback-9502-thread-3-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 3205973 WARN  (zkCallback-9502-thread-3-processing-n:127.0.0.1:32923_solr) [n:127.0.0.1:32923_solr    ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:32923_solr
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:32923_solr
   [junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:364)
   [junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:364)
   [junit4]   2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:879)
   [junit4]   2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:704)
   [junit4]   2> at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
   [junit4]   2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:703)
   [junit4]   2> at org.apache.solr.common.cloud.ZkStateReader.access$900(ZkStateReader.java:72)
   [junit4]   2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1090)
   [junit4]   2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1085)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:268)
   [junit4]   2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3205973 INFO  (jetty-closer-9487-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 3205973 INFO  (jetty-closer-9487-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2e2e5287: rootName = solr_36703, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@16cfa038
   [junit4]   2> 3205973 ERROR (Thread[Thread-7368,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:32923_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 3205974 INFO  (jetty-closer-9487-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5ceaa771{/solr,null,UNAVAILABLE}
   [junit4]   2> 3205975 INFO  (jetty-closer-9487-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36703_solr
   [junit4]   2> 3205976 INFO  (jetty-closer-9487-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 3205976 INFO  (zkCallback-9504-thread-3-processing-n:127.0.0.1:36703_solr) [n:127.0.0.1:36703_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 3205978 INFO  (coreCloseExecutor-11649-thread-1) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@21c7a29
   [junit4]   2> 3205979 INFO  (coreCloseExecutor-11649-thread-1) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=35420713
   [junit4]   2> 3205979 INFO  (coreCloseExecutor-11649-thread-1) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ad7ab6c: rootName = solr_36703, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@10d2fe10
   [junit4]   2> 3205992 INFO  (coreCloseExecutor-11649-thread-1) [n:127.0.0.1:36703_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=35420713
   [junit4]   2> 3205995 INFO  (jetty-closer-9487-thread-1) [    ] o.a.s.c.Overseer Overseer (id=99341293280624646-127.0.0.1:36703_solr-n_0000000000) closing
   [junit4]   2> 3205995 INFO  (OverseerStateUpdate-99341293280624646-127.0.0.1:36703_solr-n_0000000000) [n:127.0.0.1:36703_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:36703_solr
   [junit4]   2> 3206003 WARN  (OverseerAutoScalingTriggerThread-99341293280624646-127.0.0.1:36703_solr-n_0000000000) [n:127.0.0.1:36703_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 3206005 ERROR (Thread[Thread-7365,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:36703_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 3206007 INFO  (jetty-closer-9487-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2f39c3c1{/solr,null,UNAVAILABLE}
   [junit4]   2> 3206007 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[B98C602AD2D25541]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3206008 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[B98C602AD2D25541]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36319 36319
   [junit4]   2> 3206717 INFO  (Thread-7348) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36319 36319
   [junit4]   2> 3206719 WARN  (Thread-7348) [    ] o.a.s.c.ZkTestServer Watch limit violations:
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2>
   [ju

[...truncated too long message...]

cutor-7473-thread-1) [n:127.0.0.1:37329_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore [.system_shard1_replica_p4]  CLOSING SolrCore org.apache.solr.core.SolrCore@12a9e2fc
   [junit4]   2> 3335103 INFO  (jetty-closer-3565-thread-3) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 3335103 INFO  (coreCloseExecutor-7473-thread-1) [n:127.0.0.1:37329_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core..system.shard1.replica_p4, tag=313123580
   [junit4]   2> 3335103 INFO  (zkCallback-3610-thread-2-processing-n:127.0.0.1:39815_solr) [n:127.0.0.1:39815_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 3335103 INFO  (coreCloseExecutor-7473-thread-1) [n:127.0.0.1:37329_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@289e2600: rootName = solr_37329, domain = solr.core..system.shard1.replica_p4, service url = null, agent id = null] for registry solr.core..system.shard1.replica_p4 / com.codahale.metrics.MetricRegistry@49684e9b
   [junit4]   2> 3335103 INFO  (zkCallback-3590-thread-3-processing-n:127.0.0.1:36033_solr) [n:127.0.0.1:36033_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 3335103 INFO  (zkCallback-3586-thread-2-processing-n:127.0.0.1:37329_solr) [n:127.0.0.1:37329_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 3335104 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160ee638eff000e, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 3335104 INFO  (jetty-closer-3565-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6cfe38b3{/solr,null,UNAVAILABLE}
   [junit4]   2> 3335112 INFO  (coreCloseExecutor-7472-thread-1) [n:127.0.0.1:36033_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=732088155
   [junit4]   2> 3335113 INFO  (jetty-closer-3565-thread-2) [    ] o.a.s.c.Overseer Overseer (id=99341303170400265-127.0.0.1:36033_solr-n_0000000001) closing
   [junit4]   2> 3335114 INFO  (OverseerStateUpdate-99341303170400265-127.0.0.1:36033_solr-n_0000000001) [n:127.0.0.1:36033_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:36033_solr
   [junit4]   2> 3335115 WARN  (OverseerAutoScalingTriggerThread-99341303170400265-127.0.0.1:36033_solr-n_0000000001) [n:127.0.0.1:36033_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 3335118 INFO  (zkCallback-3586-thread-2-processing-n:127.0.0.1:37329_solr) [n:127.0.0.1:37329_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37329_solr
   [junit4]   2> 3335118 INFO  (jetty-closer-3565-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7c6dcb8c{/solr,null,UNAVAILABLE}
   [junit4]   2> 3335122 INFO  (coreCloseExecutor-7473-thread-1) [n:127.0.0.1:37329_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=313123580
   [junit4]   2> 3335123 INFO  (jetty-closer-3565-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4c270f47{/solr,null,UNAVAILABLE}
   [junit4]   2> 3335124 ERROR (SUITE-TestClusterStateProvider-seed#[B98C602AD2D25541]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3335124 INFO  (SUITE-TestClusterStateProvider-seed#[B98C602AD2D25541]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43721 43721
   [junit4]   2> 3335897 INFO  (Thread-8448) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43721 43721
   [junit4]   2> 3335897 WARN  (Thread-8448) [    ] o.a.s.c.ZkTestServer Watch limit violations:
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2>
   [junit4]   2> 5 /solr/aliases.json
   [junit4]   2> 4 /solr/security.json
   [junit4]   2> 3 /solr/configs/.system
   [junit4]   2> 3 /solr/configs/.system/managed-schema
   [junit4]   2>
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2>
   [junit4]   2> 23 /solr/collections/.system/state.json
   [junit4]   2> 5 /solr/clusterstate.json
   [junit4]   2> 5 /solr/clusterprops.json
   [junit4]   2> 2 /solr/autoscaling.json
   [junit4]   2>
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2>
   [junit4]   2> 5 /solr/live_nodes
   [junit4]   2> 5 /solr/collections
   [junit4]   2> 2 /solr/overseer/queue
   [junit4]   2> 2 /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 2 /solr/overseer/collection-queue-work
   [junit4]   2> 2 /solr/overseer/queue-work
   [junit4]   2>
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_B98C602AD2D25541-001
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=en-MT, timezone=Asia/Bahrain
   [junit4]   2> NOTE: Linux 4.13.0-26-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=228467064,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestRandomCollapseQParserPlugin, TestRandomDVFaceting, InfixSuggestersTest, EnumFieldTest, TestDelegationWithHadoopAuth, TestRecoveryHdfs, TestInPlaceUpdatesStandalone, TestSQLHandlerNonCloud, TestSolrIndexConfig, VMParamsZkACLAndCredentialsProvidersTest, TestPKIAuthenticationPlugin, TestReplicationHandler, TestPolicyCloud, BasicAuthStandaloneTest, SliceStateTest, BasicZkTest, SolrPluginUtilsTest, JvmMetricsTest, StatsReloadRaceTest, TestPhraseSuggestions, QueryParsingTest, CdcrReplicationDistributedZkTest, AssignBackwardCompatibilityTest, TestCloudPseudoReturnFields, URLClassifyProcessorTest, TestDistribStateManager, BadCopyFieldTest, TestCustomSort, TestManagedSchemaAPI, SpatialFilterTest, SolrShardReporterTest, LeaderFailoverAfterPartitionTest, RAMDirectoryFactoryTest, TestCloudNestedDocsSort, SimpleCollectionCreateDeleteTest, TestSolrJ, TestZkAclsWithHadoopAuth, ConnectionManagerTest, TestSuggestSpellingConverter, TestLegacyField, TestPostingsSolrHighlighter, ResponseLogComponentTest, HdfsTlogReplayBufferedWhileIndexingTest, TestCSVLoader, TestDistributedSearch, RemoteQueryErrorTest, SimpleFacetsTest, NoCacheHeaderTest, CacheHeaderTest, SolrXmlInZkTest, SimpleMLTQParserTest, BasicFunctionalityTest, TestJavabinTupleStreamParser, CachingDirectoryFactoryTest, CursorPagingTest, DocValuesTest, DateFieldTest, TestSolrCoreParser, UpdateRequestProcessorFactoryTest, DocumentBuilderTest, CoreMergeIndexesAdminHandlerTest, TestExactStatsCache, TestSchemaNameResource, UninvertDocValuesMergePolicyTest, MissingSegmentRecoveryTest, HdfsRestartWhileUpdatingTest, AddSchemaFieldsUpdateProcessorFactoryTest, OverseerTaskQueueTest, TestRebalanceLeaders, LeaderElectionIntegrationTest, SearchHandlerTest, TolerantUpdateProcessorTest, TestSortByMinMaxFunction, TestCollapseQParserPlugin, DirectUpdateHandlerOptimizeTest, TestExportWriter, TestBlendedInfixSuggestions, TestFieldCacheSort, TestHighlightDedupGrouping, TestTlogReplica, FastVectorHighlighterTest, StatelessScriptUpdateProcessorFactoryTest, LeaderInitiatedRecoveryOnShardRestartTest, BaseCdcrDistributedZkTest, HdfsChaosMonkeyNothingIsSafeTest, TestGraphTermsQParserPlugin, TestRTimerTree, TestPullReplicaErrorHandling, TestOnReconnectListenerSupport, NumberUtilsTest, DirectoryFactoryTest, RestartWhileUpdatingTest, SchemaApiFailureTest, TermsComponentTest, CursorMarkTest, AnalysisErrorHandlingTest, BasicDistributedZkTest, SolrInfoBeanTest, SearchRateTriggerTest, HighlighterMaxOffsetTest, CollectionStateFormat2Test, StressHdfsTest, SolrMetricManagerTest, TestFastOutputStream, DistributedQueryComponentOptimizationTest, TestCorePropertiesReload, CdcrVersionReplicationTest, TestStressCloudBlindAtomicUpdates, TestRandomFaceting, TestPivotHelperCode, TestFieldResource, TestIndexingPerformance, TestDocTermOrds, FullHLLTest, TestLeaderElectionWithEmptyReplica, TestLegacyNumericRangeQueryBuilder, TestShortCircuitedRequests, TestLargeCluster, PrimitiveFieldTypeTest, TestUpdate, TestLuceneIndexBackCompat, TestReversedWildcardFilterFactory, TestCrossCoreJoin, TestConfig, TestClusterProperties, TestLocalFSCloudBackupRestore, TestJoin, DistributedVersionInfoTest, ForceLeaderTest, LeaderElectionContextKeyTest, LeaderFailureAfterFreshStartTest, MoveReplicaHDFSTest, OverseerCollectionConfigSetProcessorTest, ReplaceNodeTest, SSLMigrationTest, SaslZkACLProviderTest, TestAuthenticationFramework, TestCloudInspectUtil, TestCloudPivotFacet, TestConfigSetsAPI, TestDistribDocBasedVersion, TestHdfsCloudBackupRestore, TestPrepRecovery, TestRandomFlRTGCloud, TestSkipOverseerOperations, TestTolerantUpdateProcessorCloud, TestTolerantUpdateProcessorRandomCloud, TestUtilizeNode, AutoScalingHandlerTest, ExecutePlanActionTest, NodeAddedTriggerTest, TestPolicyCloud, TestClusterStateProvider]
   [junit4] Completed [570/766 (2!)] on J0 in 5.23s, 2 tests, 1 failure <<< FAILURES!

[...truncated 48795 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_144) - Build # 1172 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1172/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig

Error Message:
expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}>

Stack Trace:
java.lang.AssertionError: expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}>
        at __randomizedtesting.SeedInfo.seed([7512B513737E3A18:4A9AB6BB6428CAFF]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig(TestClusterStateProvider.java:214)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12536 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider
   [junit4]   2> 1038433 INFO  (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/init-core-data-001
   [junit4]   2> 1038434 WARN  (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
   [junit4]   2> 1038434 INFO  (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1038435 INFO  (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1038436 INFO  (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.s.c.a.s.TestClusterStateProvider ####### Using simulated components? true
   [junit4]   2> 1038437 INFO  (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/tempDir-001
   [junit4]   2> 1038437 INFO  (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1038437 INFO  (Thread-1301) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1038438 INFO  (Thread-1301) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1038446 ERROR (Thread-1301) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1038538 INFO  (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:38005
   [junit4]   2> 1038540 INFO  (zkConnectionManagerCallback-1112-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038547 INFO  (jetty-launcher-1109-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1038547 INFO  (jetty-launcher-1109-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1038547 INFO  (jetty-launcher-1109-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1038548 INFO  (jetty-launcher-1109-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@51c1abc6{/solr,null,AVAILABLE}
   [junit4]   2> 1038548 INFO  (jetty-launcher-1109-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4fda0cc8{/solr,null,AVAILABLE}
   [junit4]   2> 1038548 INFO  (jetty-launcher-1109-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4f6e19cd{SSL,[ssl, http/1.1]}{127.0.0.1:37667}
   [junit4]   2> 1038548 INFO  (jetty-launcher-1109-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7b7b46c7{SSL,[ssl, http/1.1]}{127.0.0.1:36273}
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-3) [    ] o.e.j.s.Server Started @1040407ms
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-1) [    ] o.e.j.s.Server Started @1040407ms
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37667}
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36273}
   [junit4]   2> 1038549 ERROR (jetty-launcher-1109-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1038549 ERROR (jetty-launcher-1109-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T11:56:36.083Z
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T11:56:36.083Z
   [junit4]   2> 1038549 INFO  (jetty-launcher-1109-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@55ec741{/solr,null,AVAILABLE}
   [junit4]   2> 1038559 INFO  (jetty-launcher-1109-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@54785b0d{SSL,[ssl, http/1.1]}{127.0.0.1:42563}
   [junit4]   2> 1038560 INFO  (jetty-launcher-1109-thread-2) [    ] o.e.j.s.Server Started @1040417ms
   [junit4]   2> 1038560 INFO  (jetty-launcher-1109-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42563}
   [junit4]   2> 1038560 ERROR (jetty-launcher-1109-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1038560 INFO  (jetty-launcher-1109-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1038560 INFO  (jetty-launcher-1109-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1038560 INFO  (jetty-launcher-1109-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1038560 INFO  (jetty-launcher-1109-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T11:56:36.094Z
   [junit4]   2> 1038560 INFO  (zkConnectionManagerCallback-1114-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038560 INFO  (zkConnectionManagerCallback-1116-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038561 INFO  (jetty-launcher-1109-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1038561 INFO  (jetty-launcher-1109-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1038564 INFO  (zkConnectionManagerCallback-1118-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038571 INFO  (jetty-launcher-1109-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1038576 INFO  (jetty-launcher-1109-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38005/solr
   [junit4]   2> 1038576 INFO  (jetty-launcher-1109-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38005/solr
   [junit4]   2> 1038588 INFO  (jetty-launcher-1109-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38005/solr
   [junit4]   2> 1038593 INFO  (zkConnectionManagerCallback-1123-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038606 INFO  (zkConnectionManagerCallback-1126-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038619 INFO  (zkConnectionManagerCallback-1130-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038634 INFO  (zkConnectionManagerCallback-1132-thread-1-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038661 INFO  (zkConnectionManagerCallback-1134-thread-1-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038665 INFO  (zkConnectionManagerCallback-1136-thread-1-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038671 INFO  (jetty-launcher-1109-thread-2) [n:127.0.0.1:42563_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1038674 INFO  (jetty-launcher-1109-thread-2) [n:127.0.0.1:42563_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42563_solr
   [junit4]   2> 1038675 INFO  (jetty-launcher-1109-thread-2) [n:127.0.0.1:42563_solr    ] o.a.s.c.Overseer Overseer (id=99342391441883145-127.0.0.1:42563_solr-n_0000000000) starting
   [junit4]   2> 1038675 INFO  (jetty-launcher-1109-thread-1) [n:127.0.0.1:36273_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1038677 INFO  (jetty-launcher-1109-thread-1) [n:127.0.0.1:36273_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36273_solr
   [junit4]   2> 1038698 INFO  (zkCallback-1133-thread-1-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1038706 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1038708 INFO  (jetty-launcher-1109-thread-2) [n:127.0.0.1:42563_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42563_solr
   [junit4]   2> 1038713 INFO  (zkCallback-1133-thread-1-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1038715 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1038720 INFO  (jetty-launcher-1109-thread-3) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1038721 INFO  (jetty-launcher-1109-thread-3) [n:127.0.0.1:37667_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1038722 INFO  (jetty-launcher-1109-thread-3) [n:127.0.0.1:37667_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37667_solr
   [junit4]   2> 1038722 INFO  (zkCallback-1133-thread-1-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1038744 INFO  (zkCallback-1135-thread-2-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1038758 INFO  (zkCallback-1131-thread-1-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1038785 INFO  (jetty-launcher-1109-thread-2) [n:127.0.0.1:42563_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42563.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1038794 INFO  (jetty-launcher-1109-thread-2) [n:127.0.0.1:42563_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42563.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1038794 INFO  (jetty-launcher-1109-thread-2) [n:127.0.0.1:42563_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42563.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1038795 INFO  (jetty-launcher-1109-thread-2) [n:127.0.0.1:42563_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/tempDir-001/node2/.
   [junit4]   2> 1038796 INFO  (jetty-launcher-1109-thread-3) [n:127.0.0.1:37667_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37667.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1038797 INFO  (jetty-launcher-1109-thread-1) [n:127.0.0.1:36273_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36273.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1038801 INFO  (jetty-launcher-1109-thread-3) [n:127.0.0.1:37667_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37667.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1038802 INFO  (jetty-launcher-1109-thread-3) [n:127.0.0.1:37667_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37667.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1038802 INFO  (jetty-launcher-1109-thread-3) [n:127.0.0.1:37667_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/tempDir-001/node3/.
   [junit4]   2> 1038804 INFO  (jetty-launcher-1109-thread-1) [n:127.0.0.1:36273_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36273.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1038805 INFO  (jetty-launcher-1109-thread-1) [n:127.0.0.1:36273_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36273.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1038806 INFO  (jetty-launcher-1109-thread-1) [n:127.0.0.1:36273_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/tempDir-001/node1/.
   [junit4]   2> 1038875 INFO  (zkConnectionManagerCallback-1144-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038878 INFO  (zkConnectionManagerCallback-1148-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1038879 INFO  (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1038879 INFO  (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38005/solr ready
   [junit4]   2> 1038903 INFO  (qtp685815183-6393) [n:127.0.0.1:37667_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=1&replicationFactor=2&name=.system&nrtReplicas=2&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1038906 INFO  (OverseerThreadFactory-2715-thread-1-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.CreateCollectionCmd Create collection .system
   [junit4]   2> 1039010 INFO  (OverseerStateUpdate-99342391441883145-127.0.0.1:42563_solr-n_0000000000) [n:127.0.0.1:42563_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42563/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 1039011 INFO  (OverseerStateUpdate-99342391441883145-127.0.0.1:42563_solr-n_0000000000) [n:127.0.0.1:42563_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:37667/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 1039012 INFO  (OverseerStateUpdate-99342391441883145-127.0.0.1:42563_solr-n_0000000000) [n:127.0.0.1:42563_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_p4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36273/solr",
   [junit4]   2>   "type":"PULL",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 1039217 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1039217 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1039240 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_p4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=PULL
   [junit4]   2> 1039240 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1039241 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1039241 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1039343 INFO  (zkCallback-1133-thread-1-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1039343 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1039343 INFO  (zkCallback-1135-thread-2-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1039343 INFO  (zkCallback-1131-thread-1-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1039343 INFO  (zkCallback-1133-thread-2-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1039343 INFO  (zkCallback-1131-thread-2-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1040227 WARN  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.Config You should not use LATEST as luceneMatchVersion property: if you use this setting, and then Solr upgrades to a newer release of Lucene, sizable changes may happen. If precise back compatibility is important then you should instead explicitly specify an actual Lucene version.
   [junit4]   2> 1040228 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1040231 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 1040233 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
   [junit4]   2> 1040254 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 1040254 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
   [junit4]   2> 1040257 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1040260 WARN  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ManagedIndexSchemaFactory The schema has been upgraded to managed, but the non-managed schema schema.xml is still loadable.  PLEASE REMOVE THIS FILE.
   [junit4]   2> 1040262 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1040263 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.IndexSchema [.system_shard1_replica_p4] Schema name=_system collection or core
   [junit4]   2> 1040265 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
   [junit4]   2> 1040265 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n2' using configuration from collection .system, trusted=true
   [junit4]   2> 1040265 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37667.solr.core..system.shard1.replica_n2' (registry 'solr.core..system.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1040266 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1040266 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [[.system_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/tempDir-001/node3/.system_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/tempDir-001/node3/./.system_shard1_replica_n2/data/]
   [junit4]   2> 1040266 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 1040266 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_p4' using configuration from collection .system, trusted=true
   [junit4]   2> 1040266 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
   [junit4]   2> 1040266 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36273.solr.core..system.shard1.replica_p4' (registry 'solr.core..system.shard1.replica_p4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1040266 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1040266 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore [[.system_shard1_replica_p4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/tempDir-001/node1/.system_shard1_replica_p4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/tempDir-001/node1/./.system_shard1_replica_p4/data/]
   [junit4]   2> 1040269 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 1040269 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from collection .system, trusted=true
   [junit4]   2> 1040269 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42563.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1040269 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1040269 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/tempDir-001/node2/.system_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/tempDir-001/node2/./.system_shard1_replica_n1/data/]
   [junit4]   2> 1040309 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1040310 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1040310 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
   [junit4]   2> 1040310 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1040310 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
   [junit4]   2> 1040310 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1040312 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@4211d4f4[.system_shard1_replica_n2] main]
   [junit4]   2> 1040312 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1040312 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1040312 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.SolrIndexSearcher Opening [Searcher@64691d3e[.system_shard1_replica_p4] main]
   [junit4]   2> 1040339 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 1040339 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 1040339 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 1040339 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 1040339 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 1040339 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 1040339 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
   [junit4]   2> 1040339 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1040339 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1040339 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1040340 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1040340 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1040340 INFO  (searcherExecutor-2722-thread-1-processing-n:127.0.0.1:37667_solr x:.system_shard1_replica_n2 s:shard1 c:.system r:core_node5) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@4211d4f4[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1040341 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589478265061376000
   [junit4]   2> 1040341 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.ZkController .system_shard1_replica_p4 starting background replication from leader
   [junit4]   2> 1040341 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 1040341 INFO  (searcherExecutor-2723-thread-1-processing-n:127.0.0.1:36273_solr x:.system_shard1_replica_p4 s:shard1 c:.system r:core_node6) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@64691d3e[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1040341 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@326fde5e[.system_shard1_replica_n1] main]
   [junit4]   2> 1040341 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 1040342 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 1040342 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 1040342 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1040342 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 1040342 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1040342 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1040343 INFO  (searcherExecutor-2724-thread-1-processing-n:127.0.0.1:42563_solr x:.system_shard1_replica_n1 s:shard1 c:.system r:core_node3) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@326fde5e[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1040343 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589478265063473152
   [junit4]   2> 1040344 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1040444 INFO  (zkCallback-1135-thread-2-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1040444 INFO  (zkCallback-1133-thread-2-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1040444 INFO  (zkCallback-1133-thread-1-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1040444 INFO  (zkCallback-1131-thread-1-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1040444 INFO  (zkCallback-1131-thread-2-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1040444 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1040844 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1040844 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1040844 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:37667/solr/.system_shard1_replica_n2/
   [junit4]   2> 1040845 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n2 url=https://127.0.0.1:37667/solr START replicas=[https://127.0.0.1:42563/solr/.system_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 1040847 INFO  (qtp1896886098-6398) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.S.Request [.system_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1041145 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n2 url=https://127.0.0.1:37667/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 1041145 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1041145 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1041145 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1041147 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:37667/solr/.system_shard1_replica_n2/ shard1
   [junit4]   2> 1041248 INFO  (zkCallback-1135-thread-2-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1041248 INFO  (zkCallback-1133-thread-1-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1041248 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1041248 INFO  (zkCallback-1133-thread-2-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1041248 INFO  (zkCallback-1131-thread-1-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1041248 INFO  (zkCallback-1131-thread-2-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1041293 INFO  (indexFetcher-2737-thread-1) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.IndexFetcher Replica core_node5 is leader but it's state is down, skipping replication
   [junit4]   2> 1041298 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1041299 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2082
   [junit4]   2> 1041344 INFO  (qtp191069380-6394) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_p4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=2103
   [junit4]   2> 1041347 INFO  (qtp1896886098-6396) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2106
   [junit4]   2> 1041348 INFO  (qtp685815183-6393) [n:127.0.0.1:37667_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1041447 INFO  (zkCallback-1135-thread-2-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1041447 INFO  (zkCallback-1133-thread-2-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1041447 INFO  (zkCallback-1133-thread-1-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1041447 INFO  (zkCallback-1131-thread-2-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1041447 INFO  (zkCallback-1131-thread-1-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1041450 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1042349 INFO  (qtp685815183-6393) [n:127.0.0.1:37667_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=1&replicationFactor=2&name=.system&nrtReplicas=2&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3445
   [junit4]   2> 1042352 INFO  (qtp685815183-6414) [n:127.0.0.1:37667_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1042355 INFO  (qtp1896886098-6398) [n:127.0.0.1:42563_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1042358 INFO  (qtp191069380-6416) [n:127.0.0.1:36273_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 1042382 INFO  (TEST-TestClusterStateProvider.testAutoScalingConfig-seed#[7512B513737E3A18]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAutoScalingConfig
   [junit4]   2> 1042385 INFO  (TEST-TestClusterStateProvider.testAutoScalingConfig-seed#[7512B513737E3A18]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testAutoScalingConfig
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestClusterStateProvider -Dtests.method=testAutoScalingConfig -Dtests.seed=7512B513737E3A18 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es -Dtests.timezone=America/Campo_Grande -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.03s J1 | TestClusterStateProvider.testAutoScalingConfig <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
   [junit4]    >   "cluster-preferences":[{"maximize":"freedisk"}],
   [junit4]    >   "triggers":{".auto_add_replicas":{
   [junit4]    >       "name":".auto_add_replicas",
   [junit4]    >       "event":"nodeLost",
   [junit4]    >       "waitFor":30,
   [junit4]    >       "actions":[
   [junit4]    >         {
   [junit4]    >           "name":"auto_add_replicas_plan",
   [junit4]    >           "class":"solr.AutoAddReplicasPlanAction"},
   [junit4]    >         {
   [junit4]    >           "name":"execute_plan",
   [junit4]    >           "class":"solr.ExecutePlanAction"}],
   [junit4]    >       "enabled":true}},
   [junit4]    >   "listeners":{".auto_add_replicas.system":{
   [junit4]    >       "trigger":".auto_add_replicas",
   [junit4]    >       "afterAction":[],
   [junit4]    >       "stage":[
   [junit4]    >         "STARTED",
   [junit4]    >         "ABORTED",
   [junit4]    >         "SUCCEEDED",
   [junit4]    >         "FAILED",
   [junit4]    >         "BEFORE_ACTION",
   [junit4]    >         "AFTER_ACTION",
   [junit4]    >         "IGNORED"],
   [junit4]    >       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
   [junit4]    >       "beforeAction":[]}},
   [junit4]    >   "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
   [junit4]    >   "cluster-preferences":[{"maximize":"freedisk"}],
   [junit4]    >   "triggers":{".auto_add_replicas":{
   [junit4]    >       "name":".auto_add_replicas",
   [junit4]    >       "event":"nodeLost",
   [junit4]    >       "waitFor":30,
   [junit4]    >       "actions":[
   [junit4]    >         {
   [junit4]    >           "name":"auto_add_replicas_plan",
   [junit4]    >           "class":"solr.AutoAddReplicasPlanAction"},
   [junit4]    >         {
   [junit4]    >           "name":"execute_plan",
   [junit4]    >           "class":"solr.ExecutePlanAction"}],
   [junit4]    >       "enabled":true}},
   [junit4]    >   "listeners":{".auto_add_replicas.system":{
   [junit4]    >       "trigger":".auto_add_replicas",
   [junit4]    >       "afterAction":[],
   [junit4]    >       "stage":[
   [junit4]    >         "STARTED",
   [junit4]    >         "ABORTED",
   [junit4]    >         "SUCCEEDED",
   [junit4]    >         "FAILED",
   [junit4]    >         "BEFORE_ACTION",
   [junit4]    >         "AFTER_ACTION",
   [junit4]    >         "IGNORED"],
   [junit4]    >       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
   [junit4]    >       "beforeAction":[]}},
   [junit4]    >   "properties":{}}>
   [junit4]    > at __randomizedtesting.SeedInfo.seed([7512B513737E3A18:4A9AB6BB6428CAFF]:0)
   [junit4]    > at org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig(TestClusterStateProvider.java:214)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1042403 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAddRemoveNode
   [junit4]   2> 1042404 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1042405 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@49231cbb{/solr,null,AVAILABLE}
   [junit4]   2> 1042405 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1d8f3d72{SSL,[ssl, http/1.1]}{127.0.0.1:33905}
   [junit4]   2> 1042406 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.e.j.s.Server Started @1044264ms
   [junit4]   2> 1042406 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33905}
   [junit4]   2> 1042406 ERROR (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1042406 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1042406 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1042406 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1042406 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T11:56:39.940Z
   [junit4]   2> 1042408 INFO  (zkConnectionManagerCallback-1150-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1042408 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1042415 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38005/solr
   [junit4]   2> 1042416 INFO  (zkConnectionManagerCallback-1154-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1042419 INFO  (zkConnectionManagerCallback-1156-thread-1-processing-n:127.0.0.1:33905_solr) [n:127.0.0.1:33905_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1042421 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [n:127.0.0.1:33905_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1042422 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [n:127.0.0.1:33905_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1042423 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [n:127.0.0.1:33905_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33905_solr
   [junit4]   2> 1042424 INFO  (zkCallback-1147-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1042424 INFO  (zkCallback-1131-thread-2-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1042424 INFO  (zkCallback-1133-thread-2-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1042424 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1042427 INFO  (zkCallback-1155-thread-1-processing-n:127.0.0.1:33905_solr) [n:127.0.0.1:33905_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1042514 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [n:127.0.0.1:33905_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33905.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1042525 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [n:127.0.0.1:33905_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33905.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1042525 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [n:127.0.0.1:33905_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33905.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bae56ba
   [junit4]   2> 1042527 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [n:127.0.0.1:33905_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001/tempDir-001/node4/.
   [junit4]   2> 1042763 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@54785b0d{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1042764 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=520718042
   [junit4]   2> 1042764 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1042764 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@285ee0a2: rootName = solr_42563, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@7921e617
   [junit4]   2> 1042769 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1042769 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1f3f08d9: rootName = solr_42563, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@229c6981
   [junit4]   2> 1042772 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1042772 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@20dbe6ea: rootName = solr_42563, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6aaf733d
   [junit4]   2> 1042773 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:42563_solr
   [junit4]   2> 1042774 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1042774 INFO  (zkCallback-1147-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1042774 INFO  (zkCallback-1155-thread-1-processing-n:127.0.0.1:33905_solr) [n:127.0.0.1:33905_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1042774 INFO  (zkCallback-1131-thread-2-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1042774 INFO  (zkCallback-1133-thread-2-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1042774 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:42563_solr) [n:127.0.0.1:42563_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 1042775 INFO  (coreCloseExecutor-2748-thread-1) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [.system_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3b518fce
   [junit4]   2> 1042775 INFO  (coreCloseExecutor-2748-thread-1) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core..system.shard1.replica_n1, tag=995200974
   [junit4]   2> 1042775 INFO  (coreCloseExecutor-2748-thread-1) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@406b63a9: rootName = solr_42563, domain = solr.core..system.shard1.replica_n1, service url = null, agent id = null] for registry solr.core..system.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@57e0dbe6
   [junit4]   2> 1042781 INFO  (coreCloseExecutor-2748-thread-1) [n:127.0.0.1:42563_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=995200974
   [junit4]   2> 1042783 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.c.Overseer Overseer (id=99342391441883145-127.0.0.1:42563_solr-n_0000000000) closing
   [junit4]   2> 1042783 INFO  (OverseerStateUpdate-99342391441883145-127.0.0.1:42563_solr-n_0000000000) [n:127.0.0.1:42563_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:42563_solr
   [junit4]   2> 1042783 WARN  (OverseerAutoScalingTriggerThread-99342391441883145-127.0.0.1:42563_solr-n_0000000000) [n:127.0.0.1:42563_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1042784 INFO  (zkCallback-1133-thread-2-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36273_solr
   [junit4]   2> 1042784 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@55ec741{/solr,null,UNAVAILABLE}
   [junit4]   2> 1042790 INFO  (zkCallback-1133-thread-2-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.Overseer Overseer (id=99342391441883144-127.0.0.1:36273_solr-n_0000000001) starting
   [junit4]   2> 1042793 INFO  (zkCallback-1131-thread-2-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1042793 INFO  (zkCallback-1131-thread-1-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1042793 INFO  (zkCallback-1133-thread-2-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1042793 INFO  (zkCallback-1133-thread-1-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1042985 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[7512B513737E3A18]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testAddRemoveNode
   [junit4]   2> 1042985 WARN  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1042988 INFO  (jetty-closer-1110-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@4f6e19cd{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1042990 INFO  (jetty-closer-1110-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=981804225
   [junit4]   2> 1042990 INFO  (jetty-closer-1110-thread-3) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1d8f3d72{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1042990 INFO  (jetty-closer-1110-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1042991 INFO  (jetty-closer-1110-thread-3) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1865155148
   [junit4]   2> 1042991 INFO  (jetty-closer-1110-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3d3d02ec: rootName = solr_37667, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@6a0bae82
   [junit4]   2> 1042990 INFO  (jetty-closer-1110-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@7b7b46c7{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1042991 INFO  (jetty-closer-1110-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1042991 INFO  (jetty-closer-1110-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1505700394
   [junit4]   2> 1042991 INFO  (jetty-closer-1110-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@28835a01: rootName = solr_33905, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3af89334
   [junit4]   2> 1042991 INFO  (jetty-closer-1110-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1042991 INFO  (jetty-closer-1110-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4a83093c: rootName = solr_36273, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2b24e3ce
   [junit4]   2> 1042995 INFO  (jetty-closer-1110-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1042996 INFO  (jetty-closer-1110-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@306c9ecf: rootName = solr_36273, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@229c6981
   [junit4]   2> 1042997 INFO  (jetty-closer-1110-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1042997 INFO  (jetty-closer-1110-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@417d892b: rootName = solr_37667, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@229c6981
   [junit4]   2> 1042998 INFO  (jetty-closer-1110-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1042998 INFO  (jetty-closer-1110-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@e3703df: rootName = solr_33905, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@229c6981
   [junit4]   2> 1043000 INFO  (jetty-closer-1110-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1043000 INFO  (jetty-closer-1110-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@11943473: rootName = solr_36273, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6aaf733d
   [junit4]   2> 1043001 INFO  (jetty-closer-1110-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36273_solr
   [junit4]   2> 1043001 INFO  (jetty-closer-1110-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1043001 INFO  (jetty-closer-1110-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1bd669a5: rootName = solr_37667, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6aaf733d
   [junit4]   2> 1043001 INFO  (jetty-closer-1110-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1043002 INFO  (zkCallback-1131-thread-1-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 1043002 INFO  (zkCallback-1155-thread-1-processing-n:127.0.0.1:33905_solr) [n:127.0.0.1:33905_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 1043002 INFO  (zkCallback-1133-thread-3-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 1043002 INFO  (coreCloseExecutor-2754-thread-1) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore [.system_shard1_replica_p4]  CLOSING SolrCore org.apache.solr.core.SolrCore@4053db4e
   [junit4]   2> 1043003 INFO  (coreCloseExecutor-2754-thread-1) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core..system.shard1.replica_p4, tag=1079237454
   [junit4]   2> 1043003 INFO  (coreCloseExecutor-2754-thread-1) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2e84cf2c: rootName = solr_36273, domain = solr.core..system.shard1.replica_p4, service url = null, agent id = null] for registry solr.core..system.shard1.replica_p4 / com.codahale.metrics.MetricRegistry@a79740c
   [junit4]   2> 1043003 INFO  (jetty-closer-1110-thread-2) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37667_solr
   [junit4]   2> 1043003 INFO  (jetty-closer-1110-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1043003 INFO  (jetty-closer-1110-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@686131e3: rootName = solr_33905, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6aaf733d
   [junit4]   2> 1043004 INFO  (zkCallback-1155-thread-1-processing-n:127.0.0.1:33905_solr) [n:127.0.0.1:33905_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1043004 INFO  (zkCallback-1131-thread-1-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1043004 INFO  (zkCallback-1133-thread-3-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1043004 INFO  (jetty-closer-1110-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1043005 INFO  (coreCloseExecutor-2755-thread-1) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [.system_shard1_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@62c37516
   [junit4]   2> 1043005 INFO  (jetty-closer-1110-thread-3) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33905_solr
   [junit4]   2> 1043005 INFO  (coreCloseExecutor-2755-thread-1) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core..system.shard1.replica_n2, tag=1656976662
   [junit4]   2> 1043005 INFO  (coreCloseExecutor-2755-thread-1) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3436dd2a: rootName = solr_37667, domain = solr.core..system.shard1.replica_n2, service url = null, agent id = null] for registry solr.core..system.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@7b21fda3
   [junit4]   2> 1043005 INFO  (jetty-closer-1110-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1043006 INFO  (jetty-closer-1110-thread-3) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1043006 INFO  (zkCallback-1131-thread-1-processing-n:127.0.0.1:37667_solr) [n:127.0.0.1:37667_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 1043006 INFO  (zkCallback-1155-thread-1-processing-n:127.0.0.1:33905_solr) [n:127.0.0.1:33905_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 1043006 INFO  (zkCallback-1133-thread-1-processing-n:127.0.0.1:36273_solr) [n:127.0.0.1:36273_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 1043007 INFO  (jetty-closer-1110-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@49231cbb{/solr,null,UNAVAILABLE}
   [junit4]   2> 1043012 INFO  (coreCloseExecutor-2755-thread-1) [n:127.0.0.1:37667_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=1656976662
   [junit4]   2> 1043014 INFO  (coreCloseExecutor-2754-thread-1) [n:127.0.0.1:36273_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=1079237454
   [junit4]   2> 1043014 INFO  (jetty-closer-1110-thread-1) [    ] o.a.s.c.Overseer Overseer (id=99342391441883144-127.0.0.1:36273_solr-n_0000000001) closing
   [junit4]   2> 1043015 INFO  (OverseerStateUpdate-99342391441883144-127.0.0.1:36273_solr-n_0000000001) [n:127.0.0.1:36273_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:36273_solr
   [junit4]   2> 1043015 WARN  (OverseerAutoScalingTriggerThread-99342391441883144-127.0.0.1:36273_solr-n_0000000001) [n:127.0.0.1:36273_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1043015 INFO  (jetty-closer-1110-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@51c1abc6{/solr,null,UNAVAILABLE}
   [junit4]   2> 1043017 INFO  (jetty-closer-1110-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4fda0cc8{/solr,null,UNAVAILABLE}
   [junit4]   2> 1043017 ERROR (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1043017 INFO  (SUITE-TestClusterStateProvider-seed#[7512B513737E3A18]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38005 38005
   [junit4]   2> 1043540 INFO  (Thread-1301) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38005 38005
   [junit4]   2> 1043540 WARN  (Thread-1301) [    ] o.a.s.c.ZkTestServer Watch limit violations:
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2>
   [junit4]   2> 5 /solr/aliases.json
   [junit4]   2> 4 /solr/security.json
   [junit4]   2> 3 /solr/configs/.system
   [junit4]   2> 3 /solr/configs/.system/managed-schema
   [junit4]   2>
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2>
   [junit4]   2> 20 /solr/collections/.system/state.json
   [junit4]   2> 5 /solr/clusterstate.json
   [junit4]   2> 5 /solr/clusterprops.json
   [junit4]   2> 2 /solr/autoscaling.json
   [junit4]   2>
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2>
   [junit4]   2> 5 /solr/live_nodes
   [junit4]   2> 5 /solr/collections
   [junit4]   2> 2 /solr/overseer/queue
   [junit4]   2> 2 /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 2 /solr/overseer/queue-work
   [junit4]   2> 2 /solr/overseer/collection-queue-work
   [junit4]   2>
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_7512B513737E3A18-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=357, maxMBSortInHeap=5.546100398192273, sim=RandomSimilarity(queryNorm=true): {}, locale=es, timezone=America/Campo_Grande
   [junit4]   2> NOTE: Linux 4.13.0-26-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=121482584,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestIntervalFaceting, MultiThreadedOCPTest, TestSchemaResource, ShardSplitTest, TestSurroundQueryParser, TestBinaryResponseWriter, LukeRequestHandlerTest, LegacyCloudClusterPropTest, TestMaxScoreQueryParser, TestStressInPlaceUpdates, OpenCloseCoreStressTest, TestImpersonationWithHadoopAuth, SolrGraphiteReporterTest, PeerSyncReplicationTest, DistributedFacetSimpleRefinementLongTailTest, TestBulkSchemaAPI, TestJmxIntegration, ShardRoutingCustomTest, TestEmbeddedSolrServerAdminHandler, CreateCollectionCleanupTest, TestRTGBase, TestCursorMarkWithoutUniqueKey, TestSmileRequest, ManagedSchemaRoundRobinCloudTest, ShowFileRequestHandlerTest, TestMultiValuedNumericRangeQuery, ExitableDirectoryReaderTest, TestExecutePlanAction, TestCloudRecovery, ZkSolrClientTest, TestInfoStreamLogging, TestMinMaxOnMultiValuedField, SecurityConfHandlerTest, TestFieldCache, TestFieldCacheSortRandom, TestUnifiedSolrHighlighter, TestRangeQuery, PrimUtilsTest, HdfsSyncSliceTest, DistributedVersionInfoTest, TestAtomicUpdateErrorCases, TestNoOpRegenerator, TestLRUStatsCache, TestComplexPhraseLeadingWildcard, WrapperMergePolicyFactoryTest, SolrIndexMetricsTest, TestFaceting, SolrCmdDistributorTest, TestRandomFlRTGCloud, TestSimpleTrackingShardHandler, BlockJoinFacetSimpleTest, PreAnalyzedUpdateProcessorTest, TestSolrQueryParser, SynonymTokenizerTest, BJQParserTest, BitVectorTest, TestClusterStateProvider]
   [junit4] Completed [251/766 (1!)] on J1 in 5.13s, 2 tests, 1 failure <<< FAILURES!

[...truncated 49845 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9.0.1) - Build # 1173 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1173/
Java: 64bit/jdk-9.0.1 -XX:-UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:35267/solr/MoveReplicaHDFSTest_failed_coll_true, https://127.0.0.1:42791/solr/MoveReplicaHDFSTest_failed_coll_true]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:35267/solr/MoveReplicaHDFSTest_failed_coll_true, https://127.0.0.1:42791/solr/MoveReplicaHDFSTest_failed_coll_true]
        at __randomizedtesting.SeedInfo.seed([F67011BA47701029:5CBDC248F0A3C5F9]:0)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:462)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:991)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
        at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:306)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:42791/solr/MoveReplicaHDFSTest_failed_coll_true: no servers hosting shard: shard2
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:436)
        ... 45 more


FAILED:  org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig

Error Message:
expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}>

Stack Trace:
java.lang.AssertionError: expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}>
        at __randomizedtesting.SeedInfo.seed([F67011BA47701029:C9F812125026E0CE]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig(TestClusterStateProvider.java:214)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 11992 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider
   [junit4]   2> 245809 INFO  (SUITE-TestClusterStateProvider-seed#[F67011BA47701029]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/init-core-data-001
   [junit4]   2> 245809 WARN  (SUITE-TestClusterStateProvider-seed#[F67011BA47701029]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 245809 INFO  (SUITE-TestClusterStateProvider-seed#[F67011BA47701029]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 245810 INFO  (SUITE-TestClusterStateProvider-seed#[F67011BA47701029]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 245810 INFO  (SUITE-TestClusterStateProvider-seed#[F67011BA47701029]-worker) [    ] o.a.s.c.a.s.TestClusterStateProvider ####### Using simulated components? true
   [junit4]   2> 245810 INFO  (SUITE-TestClusterStateProvider-seed#[F67011BA47701029]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/tempDir-001
   [junit4]   2> 245811 INFO  (SUITE-TestClusterStateProvider-seed#[F67011BA47701029]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 245811 INFO  (Thread-873) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 245811 INFO  (Thread-873) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 245812 ERROR (Thread-873) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 245911 INFO  (SUITE-TestClusterStateProvider-seed#[F67011BA47701029]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:34167
   [junit4]   2> 245913 INFO  (zkConnectionManagerCallback-382-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 245916 INFO  (jetty-launcher-379-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 245916 INFO  (jetty-launcher-379-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 245916 INFO  (jetty-launcher-379-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 245917 INFO  (jetty-launcher-379-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@56971351{/solr,null,AVAILABLE}
   [junit4]   2> 245917 INFO  (jetty-launcher-379-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36b74c0{/solr,null,AVAILABLE}
   [junit4]   2> 245918 INFO  (jetty-launcher-379-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5ee2b624{/solr,null,AVAILABLE}
   [junit4]   2> 245919 INFO  (jetty-launcher-379-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@520171f7{SSL,[ssl, http/1.1]}{127.0.0.1:34841}
   [junit4]   2> 245919 INFO  (jetty-launcher-379-thread-3) [    ] o.e.j.s.Server Started @247852ms
   [junit4]   2> 245919 INFO  (jetty-launcher-379-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34841}
   [junit4]   2> 245920 ERROR (jetty-launcher-379-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 245920 INFO  (jetty-launcher-379-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 245920 INFO  (jetty-launcher-379-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 245920 INFO  (jetty-launcher-379-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 245920 INFO  (jetty-launcher-379-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T16:51:14.221220Z
   [junit4]   2> 245919 INFO  (jetty-launcher-379-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@52880272{SSL,[ssl, http/1.1]}{127.0.0.1:34617}
   [junit4]   2> 245919 INFO  (jetty-launcher-379-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4956f263{SSL,[ssl, http/1.1]}{127.0.0.1:36995}
   [junit4]   2> 245920 INFO  (jetty-launcher-379-thread-2) [    ] o.e.j.s.Server Started @247852ms
   [junit4]   2> 245920 INFO  (jetty-launcher-379-thread-1) [    ] o.e.j.s.Server Started @247853ms
   [junit4]   2> 245920 INFO  (jetty-launcher-379-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34617}
   [junit4]   2> 245920 INFO  (jetty-launcher-379-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36995}
   [junit4]   2> 245920 ERROR (jetty-launcher-379-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 245920 ERROR (jetty-launcher-379-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 245920 INFO  (jetty-launcher-379-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 245920 INFO  (jetty-launcher-379-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 245921 INFO  (jetty-launcher-379-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 245921 INFO  (jetty-launcher-379-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 245921 INFO  (jetty-launcher-379-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 245921 INFO  (jetty-launcher-379-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T16:51:14.222053Z
   [junit4]   2> 245921 INFO  (jetty-launcher-379-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 245921 INFO  (jetty-launcher-379-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T16:51:14.222104Z
   [junit4]   2> 245925 INFO  (zkConnectionManagerCallback-384-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 245925 INFO  (jetty-launcher-379-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 245925 INFO  (zkConnectionManagerCallback-386-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 245926 INFO  (zkConnectionManagerCallback-388-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 245926 INFO  (jetty-launcher-379-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 245926 INFO  (jetty-launcher-379-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 245964 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160f06eb0410002, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 246004 INFO  (jetty-launcher-379-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34167/solr
   [junit4]   2> 246008 INFO  (jetty-launcher-379-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34167/solr
   [junit4]   2> 246015 INFO  (zkConnectionManagerCallback-392-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 246019 INFO  (jetty-launcher-379-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34167/solr
   [junit4]   2> 246020 INFO  (zkConnectionManagerCallback-396-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 246035 INFO  (zkConnectionManagerCallback-400-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 246039 INFO  (zkConnectionManagerCallback-402-thread-1-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 246042 INFO  (zkConnectionManagerCallback-404-thread-1-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 246090 INFO  (zkConnectionManagerCallback-406-thread-1-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 246095 INFO  (jetty-launcher-379-thread-2) [n:127.0.0.1:34617_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 246096 INFO  (jetty-launcher-379-thread-2) [n:127.0.0.1:34617_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34617_solr
   [junit4]   2> 246096 INFO  (jetty-launcher-379-thread-2) [n:127.0.0.1:34617_solr    ] o.a.s.c.Overseer Overseer (id=99343549996269577-127.0.0.1:34617_solr-n_0000000000) starting
   [junit4]   2> 246109 INFO  (jetty-launcher-379-thread-3) [n:127.0.0.1:34841_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 246110 INFO  (jetty-launcher-379-thread-3) [n:127.0.0.1:34841_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34841_solr
   [junit4]   2> 246127 INFO  (zkCallback-401-thread-1-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 246131 INFO  (OverseerStateUpdate-99343549996269577-127.0.0.1:34617_solr-n_0000000000) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 246132 INFO  (jetty-launcher-379-thread-2) [n:127.0.0.1:34617_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34617_solr
   [junit4]   2> 246139 INFO  (zkCallback-401-thread-1-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 246143 INFO  (jetty-launcher-379-thread-1) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 246144 INFO  (zkCallback-405-thread-1-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 246145 INFO  (jetty-launcher-379-thread-1) [n:127.0.0.1:36995_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 246146 INFO  (jetty-launcher-379-thread-1) [n:127.0.0.1:36995_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36995_solr
   [junit4]   2> 246147 INFO  (zkCallback-401-thread-1-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 246163 INFO  (zkCallback-403-thread-1-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 246163 INFO  (zkCallback-405-thread-2-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 246201 INFO  (jetty-launcher-379-thread-3) [n:127.0.0.1:34841_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34841.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 246209 INFO  (jetty-launcher-379-thread-3) [n:127.0.0.1:34841_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34841.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 246209 INFO  (jetty-launcher-379-thread-3) [n:127.0.0.1:34841_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34841.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 246210 INFO  (jetty-launcher-379-thread-2) [n:127.0.0.1:34617_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34617.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 246211 INFO  (jetty-launcher-379-thread-3) [n:127.0.0.1:34841_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/tempDir-001/node3/.
   [junit4]   2> 246218 INFO  (jetty-launcher-379-thread-2) [n:127.0.0.1:34617_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34617.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 246219 INFO  (jetty-launcher-379-thread-2) [n:127.0.0.1:34617_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34617.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 246220 INFO  (jetty-launcher-379-thread-2) [n:127.0.0.1:34617_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/tempDir-001/node2/.
   [junit4]   2> 246224 INFO  (jetty-launcher-379-thread-1) [n:127.0.0.1:36995_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36995.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 246232 INFO  (jetty-launcher-379-thread-1) [n:127.0.0.1:36995_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36995.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 246232 INFO  (jetty-launcher-379-thread-1) [n:127.0.0.1:36995_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36995.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 246233 INFO  (jetty-launcher-379-thread-1) [n:127.0.0.1:36995_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/tempDir-001/node1/.
   [junit4]   2> 246308 INFO  (zkConnectionManagerCallback-414-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 246319 INFO  (zkConnectionManagerCallback-418-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 246319 INFO  (SUITE-TestClusterStateProvider-seed#[F67011BA47701029]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 246320 INFO  (SUITE-TestClusterStateProvider-seed#[F67011BA47701029]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34167/solr ready
   [junit4]   2> 246349 INFO  (qtp1874945907-2627) [n:127.0.0.1:34617_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=1&replicationFactor=2&name=.system&nrtReplicas=2&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 246353 INFO  (OverseerThreadFactory-1100-thread-1-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.CreateCollectionCmd Create collection .system
   [junit4]   2> 246458 INFO  (OverseerStateUpdate-99343549996269577-127.0.0.1:34617_solr-n_0000000000) [n:127.0.0.1:34617_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36995/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 246458 INFO  (OverseerStateUpdate-99343549996269577-127.0.0.1:34617_solr-n_0000000000) [n:127.0.0.1:34617_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34841/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 246459 INFO  (OverseerStateUpdate-99343549996269577-127.0.0.1:34617_solr-n_0000000000) [n:127.0.0.1:34617_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_p4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34617/solr",
   [junit4]   2>   "type":"PULL",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 246667 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_p4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=PULL
   [junit4]   2> 246668 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 246676 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 246676 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 246676 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 246676 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 246779 INFO  (zkCallback-403-thread-1-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 246779 INFO  (zkCallback-401-thread-1-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 246779 INFO  (zkCallback-403-thread-2-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 246779 INFO  (zkCallback-401-thread-2-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 246779 INFO  (zkCallback-405-thread-2-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 246779 INFO  (zkCallback-405-thread-1-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 247678 WARN  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.Config You should not use LATEST as luceneMatchVersion property: if you use this setting, and then Solr upgrades to a newer release of Lucene, sizable changes may happen. If precise back compatibility is important then you should instead explicitly specify an actual Lucene version.
   [junit4]   2> 247679 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 247683 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 247685 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 247686 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 247688 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 247689 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 247690 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.IndexSchema [.system_shard1_replica_p4] Schema name=_system collection or core
   [junit4]   2> 247690 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
   [junit4]   2> 247690 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
   [junit4]   2> 247692 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 247692 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 247693 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 247695 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
   [junit4]   2> 247695 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
   [junit4]   2> 247695 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
   [junit4]   2> 247696 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
   [junit4]   2> 247696 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from collection .system, trusted=true
   [junit4]   2> 247696 WARN  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ManagedIndexSchemaFactory Error persisting managed schema resource managed-schema
   [junit4]   2> org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /configs/.system/schema.xml
   [junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
   [junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.lambda$delete$1(SolrZkClient.java:243)
   [junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:242)
   [junit4]   2> at org.apache.solr.schema.ManagedIndexSchemaFactory.zkUgradeToManagedSchema(ManagedIndexSchemaFactory.java:349)
   [junit4]   2> at org.apache.solr.schema.ManagedIndexSchemaFactory.upgradeToManagedSchema(ManagedIndexSchemaFactory.java:268)
   [junit4]   2> at org.apache.solr.schema.ManagedIndexSchemaFactory.create(ManagedIndexSchemaFactory.java:186)
   [junit4]   2> at org.apache.solr.schema.ManagedIndexSchemaFactory.create(ManagedIndexSchemaFactory.java:45)
   [junit4]   2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:75)
   [junit4]   2> at org.apache.solr.core.ConfigSetService.createIndexSchema(ConfigSetService.java:119)
   [junit4]   2> at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:92)
   [junit4]   2> at org.apache.solr.core.CoreContainer.getConfigSet(CoreContainer.java:1083)
   [junit4]   2> at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1035)
   [junit4]   2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:950)
   [junit4]   2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
   [junit4]   2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
   [junit4]   2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:380)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 247697 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36995.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 247697 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_p4' using configuration from collection .system, trusted=true
   [junit4]   2> 247696 WARN  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ManagedIndexSchemaFactory Error persisting managed schema resource managed-schema
   [junit4]   2> org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /configs/.system/schema.xml
   [junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
   [junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.lambda$delete$1(SolrZkClient.java:243)
   [junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:242)
   [junit4]   2> at org.apache.solr.schema.ManagedIndexSchemaFactory.zkUgradeToManagedSchema(ManagedIndexSchemaFactory.java:349)
   [junit4]   2> at org.apache.solr.schema.ManagedIndexSchemaFactory.upgradeToManagedSchema(ManagedIndexSchemaFactory.java:268)
   [junit4]   2> at org.apache.solr.schema.ManagedIndexSchemaFactory.create(ManagedIndexSchemaFactory.java:186)
   [junit4]   2> at org.apache.solr.schema.ManagedIndexSchemaFactory.create(ManagedIndexSchemaFactory.java:45)
   [junit4]   2> at org.apache.solr.schema.IndexSchemaFactory.buildIndexSchema(IndexSchemaFactory.java:75)
   [junit4]   2> at org.apache.solr.core.ConfigSetService.createIndexSchema(ConfigSetService.java:119)
   [junit4]   2> at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:92)
   [junit4]   2> at org.apache.solr.core.CoreContainer.getConfigSet(CoreContainer.java:1083)
   [junit4]   2> at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1035)
   [junit4]   2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:950)
   [junit4]   2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
   [junit4]   2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
   [junit4]   2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:380)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 247697 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34617.solr.core..system.shard1.replica_p4' (registry 'solr.core..system.shard1.replica_p4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 247698 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n2' using configuration from collection .system, trusted=true
   [junit4]   2> 247697 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 247698 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 247698 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore [[.system_shard1_replica_p4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/tempDir-001/node2/.system_shard1_replica_p4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/tempDir-001/node2/./.system_shard1_replica_p4/data/]
   [junit4]   2> 247698 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/tempDir-001/node1/.system_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/tempDir-001/node1/./.system_shard1_replica_n1/data/]
   [junit4]   2> 247698 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34841.solr.core..system.shard1.replica_n2' (registry 'solr.core..system.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 247698 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 247698 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [[.system_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/tempDir-001/node3/.system_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/tempDir-001/node3/./.system_shard1_replica_n2/data/]
   [junit4]   2> 247734 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
   [junit4]   2> 247734 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 247734 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 247734 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 247734 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 247734 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 247742 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b58e63d[.system_shard1_replica_p4] main]
   [junit4]   2> 247742 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
   [junit4]   2> 247742 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 247742 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
   [junit4]   2> 247742 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 247743 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@493732c[.system_shard1_replica_n1] main]
   [junit4]   2> 247743 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@17d2b0d8[.system_shard1_replica_n2] main]
   [junit4]   2> 247744 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 247744 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 247744 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 247744 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 247745 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 247745 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 247745 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 247745 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 247745 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 247747 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 247747 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 247748 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 247748 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589496801970356224
   [junit4]   2> 247749 INFO  (searcherExecutor-1109-thread-1-processing-n:127.0.0.1:34841_solr x:.system_shard1_replica_n2 s:shard1 c:.system r:core_node5) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@17d2b0d8[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 247749 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
   [junit4]   2> 247756 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 247762 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 247762 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 14 ms
   [junit4]   2> 247763 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 247763 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589496801986084864
   [junit4]   2> 247764 INFO  (searcherExecutor-1107-thread-1-processing-n:127.0.0.1:36995_solr x:.system_shard1_replica_n1 s:shard1 c:.system r:core_node3) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@493732c[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 247767 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 247769 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.IndexSchema [.system_shard1_replica_p4] Schema name=_system collection or core
   [junit4]   2> 247773 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 247773 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 6 ms
   [junit4]   2> 247774 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 247776 INFO  (searcherExecutor-1108-thread-1-processing-n:127.0.0.1:34617_solr x:.system_shard1_replica_p4 s:shard1 c:.system r:core_node6) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@1b58e63d[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 247778 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.ZkController .system_shard1_replica_p4 starting background replication from leader
   [junit4]   2> 247779 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 247782 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 247782 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 247906 INFO  (zkCallback-401-thread-2-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 247906 INFO  (zkCallback-401-thread-1-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 247906 INFO  (zkCallback-403-thread-2-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 247906 INFO  (zkCallback-403-thread-1-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 247906 INFO  (zkCallback-405-thread-3-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 247906 INFO  (zkCallback-405-thread-2-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248256 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 248256 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 248256 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:34841/solr/.system_shard1_replica_n2/
   [junit4]   2> 248256 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n2 url=https://127.0.0.1:34841/solr START replicas=[https://127.0.0.1:36995/solr/.system_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 248261 INFO  (qtp1048917493-2633) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.S.Request [.system_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 248557 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n2 url=https://127.0.0.1:34841/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 248557 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 248557 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 248557 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 248559 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:34841/solr/.system_shard1_replica_n2/ shard1
   [junit4]   2> 248660 INFO  (zkCallback-403-thread-1-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248660 INFO  (zkCallback-403-thread-2-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248660 INFO  (zkCallback-401-thread-1-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248660 INFO  (zkCallback-405-thread-3-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248660 INFO  (zkCallback-401-thread-2-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248660 INFO  (zkCallback-405-thread-2-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248707 INFO  (indexFetcher-1122-thread-1) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.IndexFetcher Replica core_node5 is leader but it's state is down, skipping replication
   [junit4]   2> 248710 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 248801 INFO  (qtp2313754-2628) [n:127.0.0.1:34841_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2125
   [junit4]   2> 248801 INFO  (qtp1874945907-2648) [n:127.0.0.1:34617_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_p4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=2133
   [junit4]   2> 248801 INFO  (qtp1048917493-2644) [n:127.0.0.1:36995_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2125
   [junit4]   2> 248803 INFO  (qtp1874945907-2627) [n:127.0.0.1:34617_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 248885 INFO  (zkCallback-403-thread-2-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248885 INFO  (zkCallback-401-thread-2-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248885 INFO  (zkCallback-405-thread-2-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248885 INFO  (zkCallback-401-thread-1-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248885 INFO  (zkCallback-405-thread-3-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 248885 INFO  (zkCallback-403-thread-1-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 249804 INFO  (qtp1874945907-2627) [n:127.0.0.1:34617_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=1&replicationFactor=2&name=.system&nrtReplicas=2&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3454
   [junit4]   2> 249809 INFO  (qtp1874945907-2632) [n:127.0.0.1:34617_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 249815 INFO  (qtp1048917493-2634) [n:127.0.0.1:36995_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 249820 INFO  (qtp2313754-2650) [n:127.0.0.1:34841_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 249850 INFO  (TEST-TestClusterStateProvider.testAutoScalingConfig-seed#[F67011BA47701029]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAutoScalingConfig
   [junit4]   2> 249853 INFO  (TEST-TestClusterStateProvider.testAutoScalingConfig-seed#[F67011BA47701029]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testAutoScalingConfig
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestClusterStateProvider -Dtests.method=testAutoScalingConfig -Dtests.seed=F67011BA47701029 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ha-GH -Dtests.timezone=Africa/Mbabane -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.03s J1 | TestClusterStateProvider.testAutoScalingConfig <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
   [junit4]    >   "cluster-preferences":[{"maximize":"freedisk"}],
   [junit4]    >   "triggers":{".auto_add_replicas":{
   [junit4]    >       "name":".auto_add_replicas",
   [junit4]    >       "event":"nodeLost",
   [junit4]    >       "waitFor":30,
   [junit4]    >       "actions":[
   [junit4]    >         {
   [junit4]    >           "name":"auto_add_replicas_plan",
   [junit4]    >           "class":"solr.AutoAddReplicasPlanAction"},
   [junit4]    >         {
   [junit4]    >           "name":"execute_plan",
   [junit4]    >           "class":"solr.ExecutePlanAction"}],
   [junit4]    >       "enabled":true}},
   [junit4]    >   "listeners":{".auto_add_replicas.system":{
   [junit4]    >       "trigger":".auto_add_replicas",
   [junit4]    >       "afterAction":[],
   [junit4]    >       "stage":[
   [junit4]    >         "STARTED",
   [junit4]    >         "ABORTED",
   [junit4]    >         "SUCCEEDED",
   [junit4]    >         "FAILED",
   [junit4]    >         "BEFORE_ACTION",
   [junit4]    >         "AFTER_ACTION",
   [junit4]    >         "IGNORED"],
   [junit4]    >       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
   [junit4]    >       "beforeAction":[]}},
   [junit4]    >   "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
   [junit4]    >   "cluster-preferences":[{"maximize":"freedisk"}],
   [junit4]    >   "triggers":{".auto_add_replicas":{
   [junit4]    >       "name":".auto_add_replicas",
   [junit4]    >       "event":"nodeLost",
   [junit4]    >       "waitFor":30,
   [junit4]    >       "actions":[
   [junit4]    >         {
   [junit4]    >           "name":"auto_add_replicas_plan",
   [junit4]    >           "class":"solr.AutoAddReplicasPlanAction"},
   [junit4]    >         {
   [junit4]    >           "name":"execute_plan",
   [junit4]    >           "class":"solr.ExecutePlanAction"}],
   [junit4]    >       "enabled":true}},
   [junit4]    >   "listeners":{".auto_add_replicas.system":{
   [junit4]    >       "trigger":".auto_add_replicas",
   [junit4]    >       "afterAction":[],
   [junit4]    >       "stage":[
   [junit4]    >         "STARTED",
   [junit4]    >         "ABORTED",
   [junit4]    >         "SUCCEEDED",
   [junit4]    >         "FAILED",
   [junit4]    >         "BEFORE_ACTION",
   [junit4]    >         "AFTER_ACTION",
   [junit4]    >         "IGNORED"],
   [junit4]    >       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
   [junit4]    >       "beforeAction":[]}},
   [junit4]    >   "properties":{}}>
   [junit4]    > at __randomizedtesting.SeedInfo.seed([F67011BA47701029:C9F812125026E0CE]:0)
   [junit4]    > at org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig(TestClusterStateProvider.java:214)
   [junit4]    > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 249878 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAddRemoveNode
   [junit4]   2> 249880 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 249882 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@73252f0c{/solr,null,AVAILABLE}
   [junit4]   2> 249883 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7eafcbe9{SSL,[ssl, http/1.1]}{127.0.0.1:36205}
   [junit4]   2> 249883 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.e.j.s.Server Started @251815ms
   [junit4]   2> 249883 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36205}
   [junit4]   2> 249883 ERROR (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 249883 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 249884 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 249884 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 249884 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T16:51:18.185059Z
   [junit4]   2> 249886 INFO  (zkConnectionManagerCallback-420-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 249887 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 249900 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34167/solr
   [junit4]   2> 249902 INFO  (zkConnectionManagerCallback-424-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 249904 INFO  (zkConnectionManagerCallback-426-thread-1-processing-n:127.0.0.1:36205_solr) [n:127.0.0.1:36205_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 249907 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [n:127.0.0.1:36205_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 249908 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [n:127.0.0.1:36205_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 249909 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [n:127.0.0.1:36205_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36205_solr
   [junit4]   2> 249910 INFO  (zkCallback-405-thread-3-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 249910 INFO  (zkCallback-401-thread-2-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 249910 INFO  (zkCallback-403-thread-1-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 249910 INFO  (zkCallback-417-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 249910 INFO  (zkCallback-425-thread-1-processing-n:127.0.0.1:36205_solr) [n:127.0.0.1:36205_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 249943 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [n:127.0.0.1:36205_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36205.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 249952 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [n:127.0.0.1:36205_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36205.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 249952 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [n:127.0.0.1:36205_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36205.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@272a83d4
   [junit4]   2> 249954 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [n:127.0.0.1:36205_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_F67011BA47701029-001/tempDir-001/node4/.
   [junit4]   2> 250182 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@520171f7{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 250183 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1009103167
   [junit4]   2> 250183 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 250183 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7baf0c91: rootName = solr_34841, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3e2c2b87
   [junit4]   2> 250190 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 250190 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6acc1d6b: rootName = solr_34841, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1284f0d6
   [junit4]   2> 250195 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 250195 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3ca335b: rootName = solr_34841, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@16bb765e
   [junit4]   2> 250196 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[F67011BA47701029]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:34841_solr
   [junit4]   2> 250196 INFO  (zkCallback-403-thread-1-processing-n:127.0.0.1:36995_solr) [n:127.0.0.1:36995_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 250196 INFO  (zkCallback-405-thread-3-processing-n:127.0.0.1:34617_solr) [n:127.0.0.1:34617_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 250196 INFO  (zkCallback-401-thread-2-processing-n:127.0.0.1:34841_solr) [n:127.0.0.1:34841_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 250197 INFO  (zkCallback-417-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live

[...truncated too long message...]

0003
   [junit4]   2> 2 /solr/overseer_elect/election/99343665593581580-127.0.0.1:33531_solr-n_0000000002
   [junit4]   2> 2 /solr/autoscaling.json
   [junit4]   2> 2 /solr/collections/MoveReplicaHDFSTest_coll_false/leader_elect/shard1/election/99343665593581578-core_node3-n_0000000001
   [junit4]   2>
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2>
   [junit4]   2> 30 /solr/collections
   [junit4]   2> 23 /solr/live_nodes
   [junit4]   2> 2 /solr/overseer/queue
   [junit4]   2> 2 /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 2 /solr/overseer/queue-work
   [junit4]   2> 2 /solr/overseer/collection-queue-work
   [junit4]   2>
   [junit4]   2> 2077334 WARN  (SUITE-MoveReplicaHDFSTest-seed#[F67011BA47701029]-worker) [    ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 2077374 INFO  (SUITE-MoveReplicaHDFSTest-seed#[F67011BA47701029]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 2077475 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_F67011BA47701029-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_F67011BA47701029-001/tempDir-002/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:34563) [    ] o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager interrupted
   [junit4]   2> 2077476 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_F67011BA47701029-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_F67011BA47701029-001/tempDir-002/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:34563) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-1613849536-88.99.242.108-1515864038545 (Datanode Uuid e834142b-3386-4884-be9b-cea3d6b92fc8) service to localhost.localdomain/127.0.0.1:34563
   [junit4]   2> 2077477 WARN  (SUITE-MoveReplicaHDFSTest-seed#[F67011BA47701029]-worker) [    ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 2077479 INFO  (SUITE-MoveReplicaHDFSTest-seed#[F67011BA47701029]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 2077583 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_F67011BA47701029-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_F67011BA47701029-001/tempDir-002/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:34563) [    ] o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager interrupted
   [junit4]   2> 2077583 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_F67011BA47701029-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_F67011BA47701029-001/tempDir-002/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:34563) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-1613849536-88.99.242.108-1515864038545 (Datanode Uuid 38e10b85-0bb0-49ab-89e3-b93589128855) service to localhost.localdomain/127.0.0.1:34563
   [junit4]   2> 2077587 INFO  (SUITE-MoveReplicaHDFSTest-seed#[F67011BA47701029]-worker) [    ] o.m.log Stopped HttpServer2$[hidden email]:0
   [junit4]   2> 2077702 INFO  (SUITE-MoveReplicaHDFSTest-seed#[F67011BA47701029]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45013 45013
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.MoveReplicaHDFSTest_F67011BA47701029-001
   [junit4]   2> Jan 13, 2018 5:21:45 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 66 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=MockRandom)}, docValues:{}, maxPointsInLeafNode=528, maxMBSortInHeap=5.775733939950592, sim=RandomSimilarity(queryNorm=true): {}, locale=vo-001, timezone=America/Recife
   [junit4]   2> NOTE: Linux 4.13.0-26-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=3,free=217675072,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [BlockJoinFacetDistribTest, TestFieldCacheVsDocValues, TestSubQueryTransformerCrossCore, SuggestComponentTest, AliasIntegrationTest, TestShardHandlerFactory, CollectionsAPIAsyncDistributedZkTest, TestConfigSets, LeaderInitiatedRecoveryOnCommitTest, V2StandaloneTest, TestQuerySenderListener, TimeRoutedAliasUpdateProcessorTest, TestCoreContainer, LoggingHandlerTest, PreAnalyzedFieldManagedSchemaCloudTest, TestNodeLostTrigger, TestManagedSynonymGraphFilterFactory, VersionInfoTest, SolrMetricsIntegrationTest, SolrJmxReporterCloudTest, WordBreakSolrSpellCheckerTest, TestPolicyCloud, TestFieldTypeResource, SuggesterTest, HighlighterTest, TestCharFilters, DocValuesMissingTest, TestDistribDocBasedVersion, TestCloudPivotFacet, TestQueryTypes, LeaderElectionTest, TestManagedSchema, TestLFUCache, CustomCollectionTest, TestCSVResponseWriter, ConnectionReuseTest, ShufflingReplicaListTransformerTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestExtendedDismaxParser, TestValueSourceCache, SSLMigrationTest, TestLeaderInitiatedRecoveryThread, CustomHighlightComponentTest, ReplicationFactorTest, TestCollectionsAPIViaSolrCloudCluster, TestCustomDocTransformer, TestPointFields, LeaderElectionContextKeyTest, BadComponentTest, TestGraphMLResponseWriter, TestFreeTextSuggestions, GraphQueryTest, UnloadDistributedZkTest, TestElisionMultitermQuery, TestMissingGroups, TestInPlaceUpdatesDistrib, TestFieldCacheReopen, ChangedSchemaMergeTest, TestCloudDeleteByQuery, TestPartialUpdateDeduplication, DistanceFunctionTest, TestStreamBody, TestTestInjection, TestObjectReleaseTracker, TestFilteredDocIdSet, DataDrivenBlockJoinTest, SpellPossibilityIteratorTest, SolrCloudExampleTest, OverseerStatusTest, DefaultValueUpdateProcessorTest, TestTolerantSearch, TestRealTimeGet, SolrCloudReportersTest, SolrTestCaseJ4Test, ClusterStateTest, TestComputePlanAction, TestSolr4Spatial2, PluginInfoTest, DirectSolrSpellCheckerTest, TestTrie, StatsComponentTest, CdcrBootstrapTest, TestRandomRequestDistribution, TestReload, FacetPivotSmallTest, TestSolrQueryResponse, FullSolrCloudDistribCmdsTest, SimplePostToolTest, TestFiltering, FileBasedSpellCheckerTest, NodeLostTriggerTest, ResponseHeaderTest, QueryElevationComponentTest, TestSystemIdResolver, DeleteNodeTest, DistributedQueryComponentCustomSortTest, HdfsDirectoryFactoryTest, EchoParamsTest, IndexBasedSpellCheckerTest, SubstringBytesRefFilterTest, TestTriggerIntegration, TestNumericTerms32, BigEndianAscendingWordDeserializerTest, UUIDFieldTest, TestDFISimilarityFactory, TestSolrConfigHandlerConcurrent, SpatialRPTFieldTypeTest, ChaosMonkeyNothingIsSafeTest, AtomicUpdatesTest, FieldAnalysisRequestHandlerTest, JSONWriterTest, TestDynamicLoading, OverseerCollectionConfigSetProcessorTest, TestQueryWrapperFilter, TestXmlQParser, XsltUpdateRequestHandlerTest, TestPullReplica, MetricsHandlerTest, HdfsThreadLeakTest, HdfsLockFactoryTest, DirectSolrConnectionTest, TestIndexSearcher, OverseerTest, BasicDistributedZk2Test, TestZkChroot, ZkCLITest, TestDistributedGrouping, TestRecovery, ZkControllerTest, SolrCoreTest, BadIndexSchemaTest, ConvertedLegacyTest, TestLazyCores, SolrIndexSplitterTest, TestCoreDiscovery, SuggesterFSTTest, SolrRequestParserTest, DocValuesTest, TestUpdate, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, TestSolrDeletionPolicy1, CacheHeaderTest, XmlUpdateRequestHandlerTest, MoreLikeThisHandlerTest, TestSolrQueryParser, TestJmxIntegration, ReturnFieldsTest, UniqFieldsUpdateProcessorFactoryTest, TestPHPSerializedResponseWriter, PingRequestHandlerTest, CSVRequestHandlerTest, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, TestBinaryField, TestSearchPerf, NumericFieldsTest, TestConfig, OutputWriterTest, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestSolrCoreProperties, NotRequiredUniqueKeyTest, TestPhraseSuggestions, TestCodecSupport, SynonymTokenizerTest, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TimeZoneUtilsTest, TestFastOutputStream, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, DateMathParserTest, PreAnalyzedFieldTest, TestSuggestSpellingConverter, DateFieldTest, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, TestLRUCache, TestUtils, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, DistributedMLTComponentTest, TestDistributedMissingSort, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, AssignBackwardCompatibilityTest, CollectionReloadTest, CollectionStateFormat2Test, CollectionsAPISolrJTest, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, DocValuesNotIndexedTest, ForceLeaderTest, MoveReplicaHDFSTest]
   [junit4] Completed [469/766 (2!)] on J2 in 77.37s, 4 tests, 1 error <<< FAILURES!

[...truncated 41903 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_144) - Build # 1174 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1174/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test

Error Message:
Could not find collection:collection2

Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
        at __randomizedtesting.SeedInfo.seed([A3B3E57100AD42F7:2BE7DAABAE512F0F]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:913)
        at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:612)
        at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig

Error Message:
expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}>

Stack Trace:
java.lang.AssertionError: expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}>
        at __randomizedtesting.SeedInfo.seed([A3B3E57100AD42F7:9C3BE6D917FBB210]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig(TestClusterStateProvider.java:214)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13025 lines...]
   [junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
   [junit4]   2> 1346481 INFO  (SUITE-FullSolrCloudDistribCmdsTest-seed#[A3B3E57100AD42F7]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/init-core-data-001
   [junit4]   2> 1346482 WARN  (SUITE-FullSolrCloudDistribCmdsTest-seed#[A3B3E57100AD42F7]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 1346482 INFO  (SUITE-FullSolrCloudDistribCmdsTest-seed#[A3B3E57100AD42F7]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1346483 INFO  (SUITE-FullSolrCloudDistribCmdsTest-seed#[A3B3E57100AD42F7]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 1346483 INFO  (SUITE-FullSolrCloudDistribCmdsTest-seed#[A3B3E57100AD42F7]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /r_/
   [junit4]   2> 1346485 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1346485 INFO  (Thread-2742) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1346485 INFO  (Thread-2742) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1346486 ERROR (Thread-2742) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1346585 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.ZkTestServer start zk server on port:39499
   [junit4]   2> 1346587 INFO  (zkConnectionManagerCallback-2412-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1346588 INFO  (zkConnectionManagerCallback-2414-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1346590 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1346591 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 1346592 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1346592 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1346593 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1346593 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1346594 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1346594 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1346595 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1346595 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1346596 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1346596 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 1346688 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1346689 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6852b148{/r_,null,AVAILABLE}
   [junit4]   2> 1346690 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4f0ba5db{HTTP/1.1,[http/1.1]}{127.0.0.1:34945}
   [junit4]   2> 1346690 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.Server Started @1348925ms
   [junit4]   2> 1346690 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/tempDir-001/control/data, hostContext=/r_, hostPort=34945, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/control-001/cores}
   [junit4]   2> 1346690 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1346690 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1346690 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1346690 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1346690 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T22:23:52.096Z
   [junit4]   2> 1346691 INFO  (zkConnectionManagerCallback-2416-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1346692 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1346692 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/control-001/solr.xml
   [junit4]   2> 1346694 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1346694 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1346695 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1346697 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39499/solr
   [junit4]   2> 1346698 INFO  (zkConnectionManagerCallback-2420-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1346699 INFO  (zkConnectionManagerCallback-2422-thread-1-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1346725 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:34945_r_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1346726 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:34945_r_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34945_r_
   [junit4]   2> 1346726 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:34945_r_    ] o.a.s.c.Overseer Overseer (id=99344857949208580-127.0.0.1:34945_r_-n_0000000000) starting
   [junit4]   2> 1346729 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:34945_r_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34945_r_
   [junit4]   2> 1346731 INFO  (zkCallback-2421-thread-1-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1346786 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:34945_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1346791 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:34945_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1346791 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:34945_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1346792 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:34945_r_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/control-001/cores
   [junit4]   2> 1346805 INFO  (zkConnectionManagerCallback-2428-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1346805 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1346805 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39499/solr ready
   [junit4]   2> 1346806 INFO  (qtp446119897-11469) [n:127.0.0.1:34945_r_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:34945_r_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1346807 INFO  (OverseerThreadFactory-5065-thread-1-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 1346910 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1346910 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1347012 INFO  (zkCallback-2421-thread-1-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1347924 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1347931 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 1348124 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1348132 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 1348133 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1348133 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1348133 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 1348135 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4953409321376111]
   [junit4]   2> 1348137 WARN  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1348174 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1348174 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1348176 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1348176 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1348177 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.849235567758425]
   [junit4]   2> 1348177 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2f8a6a51[control_collection_shard1_replica_n1] main]
   [junit4]   2> 1348196 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1348197 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1348197 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1348198 INFO  (searcherExecutor-5068-thread-1-processing-n:127.0.0.1:34945_r_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@2f8a6a51[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1348198 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589517728983547904
   [junit4]   2> 1348201 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1348201 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1348201 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34945/r_/control_collection_shard1_replica_n1/
   [junit4]   2> 1348201 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1348201 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:34945/r_/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 1348201 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1348202 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34945/r_/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 1348303 INFO  (zkCallback-2421-thread-1-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1348353 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1348354 INFO  (qtp446119897-11471) [n:127.0.0.1:34945_r_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1444
   [junit4]   2> 1348356 INFO  (qtp446119897-11469) [n:127.0.0.1:34945_r_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1348454 INFO  (zkCallback-2421-thread-1-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1348808 INFO  (OverseerCollectionConfigSetProcessor-99344857949208580-127.0.0.1:34945_r_-n_0000000000) [n:127.0.0.1:34945_r_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1349356 INFO  (qtp446119897-11469) [n:127.0.0.1:34945_r_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:34945_r_&wt=javabin&version=2} status=0 QTime=2549
   [junit4]   2> 1349359 INFO  (zkConnectionManagerCallback-2432-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1349359 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1349360 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39499/solr ready
   [junit4]   2> 1349360 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1349360 INFO  (qtp446119897-11469) [n:127.0.0.1:34945_r_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1349362 INFO  (OverseerThreadFactory-5065-thread-2-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 1349362 WARN  (OverseerThreadFactory-5065-thread-2-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 1349564 INFO  (qtp446119897-11469) [n:127.0.0.1:34945_r_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1349564 INFO  (qtp446119897-11469) [n:127.0.0.1:34945_r_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=203
   [junit4]   2> 1349621 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-1-001 of type NRT
   [junit4]   2> 1349621 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1349621 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1d58c3f0{/r_,null,AVAILABLE}
   [junit4]   2> 1349622 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@460fc194{HTTP/1.1,[http/1.1]}{127.0.0.1:39359}
   [junit4]   2> 1349622 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.Server Started @1351857ms
   [junit4]   2> 1349622 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/r_, hostPort=39359, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-1-001/cores}
   [junit4]   2> 1349622 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1349622 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1349622 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1349622 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1349622 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T22:23:55.028Z
   [junit4]   2> 1349625 INFO  (zkConnectionManagerCallback-2434-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1349626 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1349626 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-1-001/solr.xml
   [junit4]   2> 1349630 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1349630 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1349630 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1349635 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39499/solr
   [junit4]   2> 1349636 INFO  (zkConnectionManagerCallback-2438-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1349637 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160f19f38530008, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1349641 INFO  (zkConnectionManagerCallback-2440-thread-1-processing-n:127.0.0.1:39359_r_) [n:127.0.0.1:39359_r_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1349644 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:39359_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1349645 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:39359_r_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1349650 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:39359_r_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39359_r_
   [junit4]   2> 1349651 INFO  (zkCallback-2421-thread-1-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1349651 INFO  (zkCallback-2431-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1349654 INFO  (zkCallback-2439-thread-1-processing-n:127.0.0.1:39359_r_) [n:127.0.0.1:39359_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1349773 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:39359_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1349779 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:39359_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1349780 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:39359_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1349781 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:39359_r_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-1-001/cores
   [junit4]   2> 1349797 INFO  (qtp446119897-11470) [n:127.0.0.1:34945_r_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:39359_r_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1349799 INFO  (OverseerCollectionConfigSetProcessor-99344857949208580-127.0.0.1:34945_r_-n_0000000000) [n:127.0.0.1:34945_r_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1349799 INFO  (OverseerThreadFactory-5065-thread-3-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:39359_r_ for creating new replica
   [junit4]   2> 1349800 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1349801 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1350812 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1350822 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.s.IndexSchema [collection1_shard2_replica_n61] Schema name=test
   [junit4]   2> 1350869 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1350875 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n61' using configuration from collection collection1, trusted=true
   [junit4]   2> 1350875 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n61' (registry 'solr.core.collection1.shard2.replica_n61') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1350876 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1350876 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SolrCore [[collection1_shard2_replica_n61] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-1-001/cores/collection1_shard2_replica_n61], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-1-001/cores/collection1_shard2_replica_n61/data/]
   [junit4]   2> 1350878 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4953409321376111]
   [junit4]   2> 1350879 WARN  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1350908 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1350908 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1350909 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1350909 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1350910 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.849235567758425]
   [junit4]   2> 1350910 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.s.SolrIndexSearcher Opening [Searcher@347a348d[collection1_shard2_replica_n61] main]
   [junit4]   2> 1350911 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1350911 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1350911 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1350912 INFO  (searcherExecutor-5079-thread-1-processing-n:127.0.0.1:39359_r_ x:collection1_shard2_replica_n61 s:shard2 c:collection1) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SolrCore [collection1_shard2_replica_n61] Registered new searcher Searcher@347a348d[collection1_shard2_replica_n61] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1350912 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589517731829383168
   [junit4]   2> 1350916 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1350916 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1350916 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:39359/r_/collection1_shard2_replica_n61/
   [junit4]   2> 1350916 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1350916 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy http://127.0.0.1:39359/r_/collection1_shard2_replica_n61/ has no replicas
   [junit4]   2> 1350916 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1350917 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:39359/r_/collection1_shard2_replica_n61/ shard2
   [junit4]   2> 1351068 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1351074 INFO  (qtp757969246-11518) [n:127.0.0.1:39359_r_ c:collection1 s:shard2  x:collection1_shard2_replica_n61] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1273
   [junit4]   2> 1351075 INFO  (qtp446119897-11470) [n:127.0.0.1:34945_r_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:39359_r_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1277
   [junit4]   2> 1351169 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-2-001 of type NRT
   [junit4]   2> 1351170 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1351170 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2e86854e{/r_,null,AVAILABLE}
   [junit4]   2> 1351171 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@40d77f91{HTTP/1.1,[http/1.1]}{127.0.0.1:35731}
   [junit4]   2> 1351171 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.Server Started @1353406ms
   [junit4]   2> 1351171 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/r_, hostPort=35731, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-2-001/cores}
   [junit4]   2> 1351171 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1351171 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1351171 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1351171 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1351171 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T22:23:56.577Z
   [junit4]   2> 1351172 INFO  (zkConnectionManagerCallback-2444-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1351173 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1351173 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-2-001/solr.xml
   [junit4]   2> 1351176 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1351176 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1351176 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1351178 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39499/solr
   [junit4]   2> 1351179 INFO  (zkConnectionManagerCallback-2448-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1351180 INFO  (zkConnectionManagerCallback-2450-thread-1-processing-n:127.0.0.1:35731_r_) [n:127.0.0.1:35731_r_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1351183 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:35731_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1351183 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:35731_r_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1351184 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:35731_r_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35731_r_
   [junit4]   2> 1351185 INFO  (zkCallback-2439-thread-1-processing-n:127.0.0.1:39359_r_) [n:127.0.0.1:39359_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1351185 INFO  (zkCallback-2431-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1351185 INFO  (zkCallback-2421-thread-1-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1351186 INFO  (zkCallback-2449-thread-1-processing-n:127.0.0.1:35731_r_) [n:127.0.0.1:35731_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1351224 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:35731_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1351273 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:35731_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1351274 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:35731_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1351275 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:35731_r_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-2-001/cores
   [junit4]   2> 1351297 INFO  (qtp446119897-11465) [n:127.0.0.1:34945_r_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35731_r_&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1351298 INFO  (OverseerCollectionConfigSetProcessor-99344857949208580-127.0.0.1:34945_r_-n_0000000000) [n:127.0.0.1:34945_r_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1351298 INFO  (OverseerThreadFactory-5065-thread-4-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:35731_r_ for creating new replica
   [junit4]   2> 1351299 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1351299 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1352309 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1352316 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.s.IndexSchema [collection1_shard3_replica_n63] Schema name=test
   [junit4]   2> 1352363 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1352369 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard3_replica_n63' using configuration from collection collection1, trusted=true
   [junit4]   2> 1352370 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard3.replica_n63' (registry 'solr.core.collection1.shard3.replica_n63') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1352370 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1352370 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SolrCore [[collection1_shard3_replica_n63] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-2-001/cores/collection1_shard3_replica_n63], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-2-001/cores/collection1_shard3_replica_n63/data/]
   [junit4]   2> 1352371 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4953409321376111]
   [junit4]   2> 1352373 WARN  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1352403 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1352403 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1352404 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1352404 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1352405 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.849235567758425]
   [junit4]   2> 1352405 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.s.SolrIndexSearcher Opening [Searcher@50018a01[collection1_shard3_replica_n63] main]
   [junit4]   2> 1352406 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1352407 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1352407 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1352408 INFO  (searcherExecutor-5090-thread-1-processing-n:127.0.0.1:35731_r_ x:collection1_shard3_replica_n63 s:shard3 c:collection1) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SolrCore [collection1_shard3_replica_n63] Registered new searcher Searcher@50018a01[collection1_shard3_replica_n63] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1352408 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589517733398052864
   [junit4]   2> 1352411 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1352411 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1352411 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35731/r_/collection1_shard3_replica_n63/
   [junit4]   2> 1352411 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1352411 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy http://127.0.0.1:35731/r_/collection1_shard3_replica_n63/ has no replicas
   [junit4]   2> 1352411 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1352412 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35731/r_/collection1_shard3_replica_n63/ shard3
   [junit4]   2> 1352563 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1352569 INFO  (qtp244516907-11549) [n:127.0.0.1:35731_r_ c:collection1 s:shard3  x:collection1_shard3_replica_n63] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1269
   [junit4]   2> 1352570 INFO  (qtp446119897-11465) [n:127.0.0.1:34945_r_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:35731_r_&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2} status=0 QTime=1273
   [junit4]   2> 1352661 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-3-001 of type NRT
   [junit4]   2> 1352661 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1352664 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@733adfae{/r_,null,AVAILABLE}
   [junit4]   2> 1352664 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7f42e510{HTTP/1.1,[http/1.1]}{127.0.0.1:33589}
   [junit4]   2> 1352664 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.Server Started @1354900ms
   [junit4]   2> 1352664 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/r_, hostPort=33589, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-3-001/cores}
   [junit4]   2> 1352665 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1352665 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 1352665 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1352665 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1352665 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-13T22:23:58.071Z
   [junit4]   2> 1352666 INFO  (zkConnectionManagerCallback-2454-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1352666 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1352666 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-3-001/solr.xml
   [junit4]   2> 1352670 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1352670 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1352670 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1352673 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39499/solr
   [junit4]   2> 1352674 INFO  (zkConnectionManagerCallback-2458-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1352675 INFO  (zkConnectionManagerCallback-2460-thread-1-processing-n:127.0.0.1:33589_r_) [n:127.0.0.1:33589_r_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1352678 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:33589_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1352679 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:33589_r_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1352680 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:33589_r_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33589_r_
   [junit4]   2> 1352680 INFO  (zkCallback-2439-thread-1-processing-n:127.0.0.1:39359_r_) [n:127.0.0.1:39359_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1352680 INFO  (zkCallback-2431-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1352680 INFO  (zkCallback-2449-thread-1-processing-n:127.0.0.1:35731_r_) [n:127.0.0.1:35731_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1352680 INFO  (zkCallback-2421-thread-1-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1352680 INFO  (zkCallback-2459-thread-1-processing-n:127.0.0.1:33589_r_) [n:127.0.0.1:33589_r_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1352768 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:33589_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1352775 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:33589_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1352775 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:33589_r_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1352776 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [n:127.0.0.1:33589_r_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-3-001/cores
   [junit4]   2> 1352804 INFO  (qtp1140656416-11580) [n:127.0.0.1:33589_r_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:33589_r_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1352805 INFO  (OverseerCollectionConfigSetProcessor-99344857949208580-127.0.0.1:34945_r_-n_0000000000) [n:127.0.0.1:34945_r_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1352805 INFO  (OverseerThreadFactory-5065-thread-5-processing-n:127.0.0.1:34945_r_) [n:127.0.0.1:34945_r_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:33589_r_ for creating new replica
   [junit4]   2> 1352806 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n65&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1352806 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1353834 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 1353842 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.s.IndexSchema [collection1_shard1_replica_n65] Schema name=test
   [junit4]   2> 1353897 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 1353904 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n65' using configuration from collection collection1, trusted=true
   [junit4]   2> 1353904 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n65' (registry 'solr.core.collection1.shard1.replica_n65') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61102e3f
   [junit4]   2> 1353904 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1353904 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SolrCore [[collection1_shard1_replica_n65] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-3-001/cores/collection1_shard1_replica_n65], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-3-001/cores/collection1_shard1_replica_n65/data/]
   [junit4]   2> 1353906 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4953409321376111]
   [junit4]   2> 1353908 WARN  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1353933 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1353933 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1353934 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1353934 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1353934 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.849235567758425]
   [junit4]   2> 1353935 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.s.SolrIndexSearcher Opening [Searcher@bda75da[collection1_shard1_replica_n65] main]
   [junit4]   2> 1353935 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1353935 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1353936 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1353936 INFO  (searcherExecutor-5101-thread-1-processing-n:127.0.0.1:33589_r_ x:collection1_shard1_replica_n65 s:shard1 c:collection1) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SolrCore [collection1_shard1_replica_n65] Registered new searcher Searcher@bda75da[collection1_shard1_replica_n65] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1353936 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589517735000276992
   [junit4]   2> 1353938 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1353939 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1353939 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33589/r_/collection1_shard1_replica_n65/
   [junit4]   2> 1353939 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1353939 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.SyncStrategy http://127.0.0.1:33589/r_/collection1_shard1_replica_n65/ has no replicas
   [junit4]   2> 1353939 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1353940 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33589/r_/collection1_shard1_replica_n65/ shard1
   [junit4]   2> 1354090 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1354091 INFO  (qtp1140656416-11582) [n:127.0.0.1:33589_r_ c:collection1 s:shard1  x:collection1_shard1_replica_n65] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n65&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1285
   [junit4]   2> 1354092 INFO  (qtp1140656416-11580) [n:127.0.0.1:33589_r_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:33589_r_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1288
   [junit4]   2> 1354159 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-4-001 of type NRT
   [junit4]   2> 1354159 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1354160 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2d8ad17c{/r_,null,AVAILABLE}
   [junit4]   2> 1354160 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@14803ef6{HTTP/1.1,[http/1.1]}{127.0.0.1:39361}
   [junit4]   2> 1354160 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.e.j.s.Server Started @1356396ms
   [junit4]   2> 1354160 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/tempDir-001/jetty4, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/r_, hostPort=39361, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.FullSolrCloudDistribCmdsTest_A3B3E57100AD42F7-001/shard-4-001/cores}
   [junit4]   2> 1354161 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1354161 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[A3B3E57100AD42F7]) [    ] o.a.s.s.SolrDispatchFilter  ___      _    

[...truncated too long message...]

G SolrCore org.apache.solr.core.SolrCore@2ce282b9
   [junit4]   2> 2876577 INFO  (coreCloseExecutor-6527-thread-1) [n:127.0.0.1:43825_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core..system.shard1.replica_n1, tag=753042105
   [junit4]   2> 2876577 INFO  (coreCloseExecutor-6527-thread-1) [n:127.0.0.1:43825_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@210efea5: rootName = solr_43825, domain = solr.core..system.shard1.replica_n1, service url = null, agent id = null] for registry solr.core..system.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@357cf3e3
   [junit4]   2> 2876577 INFO  (jetty-closer-7744-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:43165_solr
   [junit4]   2> 2876577 INFO  (jetty-closer-7744-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 2876578 INFO  (zkCallback-7767-thread-3-processing-n:127.0.0.1:43165_solr) [n:127.0.0.1:43165_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 2876578 INFO  (zkCallback-7769-thread-3-processing-n:127.0.0.1:43825_solr) [n:127.0.0.1:43825_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 2876578 INFO  (coreCloseExecutor-6528-thread-1) [n:127.0.0.1:43165_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [.system_shard1_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@5483ed10
   [junit4]   2> 2876578 INFO  (coreCloseExecutor-6528-thread-1) [n:127.0.0.1:43165_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core..system.shard1.replica_n2, tag=1417932048
   [junit4]   2> 2876578 INFO  (coreCloseExecutor-6528-thread-1) [n:127.0.0.1:43165_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@39529ffe: rootName = solr_43165, domain = solr.core..system.shard1.replica_n2, service url = null, agent id = null] for registry solr.core..system.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@d29faa7
   [junit4]   2> 2876585 INFO  (coreCloseExecutor-6528-thread-1) [n:127.0.0.1:43165_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=1417932048
   [junit4]   2> 2876585 INFO  (jetty-closer-7744-thread-1) [    ] o.a.s.c.Overseer Overseer (id=99344957690544136-127.0.0.1:43165_solr-n_0000000001) closing
   [junit4]   2> 2876585 INFO  (OverseerStateUpdate-99344957690544136-127.0.0.1:43165_solr-n_0000000001) [n:127.0.0.1:43165_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43165_solr
   [junit4]   2> 2876586 WARN  (OverseerAutoScalingTriggerThread-99344957690544136-127.0.0.1:43165_solr-n_0000000001) [n:127.0.0.1:43165_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 2876587 INFO  (zkCallback-7769-thread-3-processing-n:127.0.0.1:43825_solr) [n:127.0.0.1:43825_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43825_solr
   [junit4]   2> 2876588 INFO  (jetty-closer-7744-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6e4f5c3{/solr,null,UNAVAILABLE}
   [junit4]   2> 2876589 INFO  (coreCloseExecutor-6527-thread-1) [n:127.0.0.1:43825_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=753042105
   [junit4]   2> 2876591 INFO  (jetty-closer-7744-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@550742b6{/solr,null,UNAVAILABLE}
   [junit4]   2> 2876591 ERROR (SUITE-TestClusterStateProvider-seed#[A3B3E57100AD42F7]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2876592 INFO  (SUITE-TestClusterStateProvider-seed#[A3B3E57100AD42F7]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45583 45583
   [junit4]   2> 2884132 INFO  (Thread-3009) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45583 45583
   [junit4]   2> 2884133 WARN  (Thread-3009) [    ] o.a.s.c.ZkTestServer Watch limit violations:
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2>
   [junit4]   2> 5 /solr/aliases.json
   [junit4]   2> 4 /solr/security.json
   [junit4]   2> 3 /solr/configs/.system
   [junit4]   2> 3 /solr/configs/.system/managed-schema
   [junit4]   2>
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2>
   [junit4]   2> 23 /solr/collections/.system/state.json
   [junit4]   2> 5 /solr/clusterstate.json
   [junit4]   2> 5 /solr/clusterprops.json
   [junit4]   2> 3 /solr/autoscaling.json
   [junit4]   2>
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2>
   [junit4]   2> 5 /solr/live_nodes
   [junit4]   2> 5 /solr/collections
   [junit4]   2> 2 /solr/overseer/queue
   [junit4]   2> 2 /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 2 /solr/overseer/queue-work
   [junit4]   2> 2 /solr/overseer/collection-queue-work
   [junit4]   2>
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_A3B3E57100AD42F7-001
   [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=20056, maxDocsPerChunk=800, blockSize=9), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=20056, blockSize=9)), sim=RandomSimilarity(queryNorm=true): {}, locale=pt-PT, timezone=Europe/Dublin
   [junit4]   2> NOTE: Linux 4.13.0-26-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=198276368,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [ReplaceNodeTest, TestSerializedLuceneMatchVersion, CoreAdminCreateDiscoverTest, TestBinaryResponseWriter, SolrIndexConfigTest, TestSolrCLIRunExample, DistributedFacetPivotLongTailTest, TestImpersonationWithHadoopAuth, ZkCLITest, CdcrUpdateLogTest, BinaryUpdateRequestHandlerTest, AnalyticsMergeStrategyTest, TestLegacyFieldCache, TestLuceneMatchVersion, LegacyCloudClusterPropTest, TestStressLucene, TestExclusionRuleCollectionAccess, NodeAddedTriggerTest, DocExpirationUpdateProcessorFactoryTest, TestBackupRepositoryFactory, ShardRoutingTest, MetricsConfigTest, TestCloudRecovery, LeaderFailureAfterFreshStartTest, MoreLikeThisHandlerTest, DateRangeFieldTest, BadIndexSchemaTest, HLLSerializationTest, TestSubQueryTransformer, LukeRequestHandlerTest, DocumentAnalysisRequestHandlerTest, TestMacros, TestReloadDeadlock, SolrIndexMetricsTest, TestXIncludeConfig, TestReloadAndDeleteDocs, TestCursorMarkWithoutUniqueKey, WrapperMergePolicyFactoryTest, DistribDocExpirationUpdateProcessorTest, ShowFileRequestHandlerTest, TestHalfAndHalfDocValues, TestSolrCloudWithKerberosAlt, BooleanFieldTest, PingRequestHandlerTest, HttpSolrCallGetCoreTest, TestDocumentBuilder, TestExecutePlanAction, TestBulkSchemaAPI, SolrIndexSplitterTest, NumericFieldsTest, TestFileDictionaryLookup, OutputWriterTest, TestSchemaResource, TestRandomFlRTGCloud, TestSchemalessBufferedUpdates, TestPayloadScoreQParserPlugin, SchemaVersionSpecificBehaviorTest, PolyFieldTest, TestManagedResource, RegexBoostProcessorTest, TestConfigSetProperties, TlogReplayBufferedWhileIndexingTest, ClusterStateUpdateTest, PreAnalyzedUpdateProcessorTest, TestNoOpRegenerator, TestFieldSortValues, SuggesterFSTTest, TestBlobHandler, BJQParserTest, ConvertedLegacyTest, TestWriterPerf, OverseerRolesTest, TestFieldCache, NotRequiredUniqueKeyTest, TestSizeLimitedDistributedMap, CollectionsAPIDistributedZkTest, TestMultiValuedNumericRangeQuery, ManagedSchemaRoundRobinCloudTest, SolrSlf4jReporterTest, TestDeleteCollectionOnDownNodes, QueryEqualityTest, HighlighterConfigTest, TestSimDistributedQueue, TestMaxTokenLenTokenizer, TestStressInPlaceUpdates, TestLockTree, SampleTest, TestFastWriter, RollingRestartTest, TestJsonRequest, TermVectorComponentDistributedTest, SecurityConfHandlerTest, DOMUtilTest, TestTrackingShardHandlerFactory, TestSmileRequest, HdfsSyncSliceTest, TestInfoStreamLogging, ChaosMonkeySafeLeaderTest, TestAnalyzedSuggestions, AssignTest, ReplicaListTransformerTest, ClassificationUpdateProcessorIntegrationTest, TestRemoteStreaming, SolrMetricReporterTest, ShardRoutingCustomTest, TestComplexPhraseLeadingWildcard, TestNamedUpdateProcessors, TestFastLRUCache, DebugComponentTest, HdfsRecoverLeaseTest, BlockCacheTest, DistributedTermsComponentTest, BlobRepositoryCloudTest, RegexBytesRefFilterTest, CdcrReplicationHandlerTest, TestCloudJSONFacetJoinDomain, DistributedFacetPivotWhiteBoxTest, TestUninvertingReader, TestCoreAdminApis, DistributedFacetSimpleRefinementLongTailTest, TestLegacyFieldReuse, SystemLogListenerTest, BasicDistributedZkTest, SolrXmlInZkTest, TestClusterProperties, TestCollectionAPI, TestDistribDocBasedVersion, TestLeaderElectionWithEmptyReplica, TestLeaderElectionZkExpiry, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestReplicaProperties, TestSSLRandomization, TestSolrCloudWithSecureImpersonation, TestStressLiveNodes, TestTlogReplica, AutoAddReplicasIntegrationTest, NodeLostTriggerTest, TestClusterStateProvider]
   [junit4] Completed [571/766 (2!)] on J1 in 15.77s, 2 tests, 1 failure <<< FAILURES!

[...truncated 48798 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_144) - Build # 1175 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1175/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig

Error Message:
expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}>

Stack Trace:
java.lang.AssertionError: expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}>
        at __randomizedtesting.SeedInfo.seed([AD8379163A9815C6:920B7ABE2DCEE521]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig(TestClusterStateProvider.java:214)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13649 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider
   [junit4]   2> 2512342 INFO  (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/init-core-data-001
   [junit4]   2> 2512343 WARN  (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=30 numCloses=30
   [junit4]   2> 2512343 INFO  (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2512344 INFO  (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2512344 INFO  (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.s.c.a.s.TestClusterStateProvider ####### Using simulated components? false
   [junit4]   2> 2512345 INFO  (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/tempDir-001
   [junit4]   2> 2512345 INFO  (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2512345 INFO  (Thread-7906) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2512345 INFO  (Thread-7906) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2512347 ERROR (Thread-7906) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2512445 INFO  (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:34945
   [junit4]   2> 2512448 INFO  (zkConnectionManagerCallback-11863-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512452 INFO  (jetty-launcher-11860-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2512452 INFO  (jetty-launcher-11860-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2512452 INFO  (jetty-launcher-11860-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2512453 INFO  (jetty-launcher-11860-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e6a319{/solr,null,AVAILABLE}
   [junit4]   2> 2512453 INFO  (jetty-launcher-11860-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9d76fe{/solr,null,AVAILABLE}
   [junit4]   2> 2512453 INFO  (jetty-launcher-11860-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d9b54e{/solr,null,AVAILABLE}
   [junit4]   2> 2512454 INFO  (jetty-launcher-11860-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@184c615{HTTP/1.1,[http/1.1]}{127.0.0.1:35949}
   [junit4]   2> 2512454 INFO  (jetty-launcher-11860-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1997688{HTTP/1.1,[http/1.1]}{127.0.0.1:44321}
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@69392b{HTTP/1.1,[http/1.1]}{127.0.0.1:43861}
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-1) [    ] o.e.j.s.Server Started @2513527ms
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-2) [    ] o.e.j.s.Server Started @2513527ms
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35949}
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43861}
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-3) [    ] o.e.j.s.Server Started @2513527ms
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44321}
   [junit4]   2> 2512455 ERROR (jetty-launcher-11860-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2512455 ERROR (jetty-launcher-11860-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2512455 ERROR (jetty-launcher-11860-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T03:28:30.489Z
   [junit4]   2> 2512456 INFO  (jetty-launcher-11860-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T03:28:30.489Z
   [junit4]   2> 2512455 INFO  (jetty-launcher-11860-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 2512456 INFO  (jetty-launcher-11860-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2512456 INFO  (jetty-launcher-11860-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2512456 INFO  (jetty-launcher-11860-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T03:28:30.490Z
   [junit4]   2> 2512457 INFO  (zkConnectionManagerCallback-11866-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512457 INFO  (zkConnectionManagerCallback-11867-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512457 INFO  (zkConnectionManagerCallback-11869-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512458 INFO  (jetty-launcher-11860-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2512458 INFO  (jetty-launcher-11860-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2512458 INFO  (jetty-launcher-11860-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2512466 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160f2b620ac0002, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2512467 INFO  (jetty-launcher-11860-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34945/solr
   [junit4]   2> 2512467 INFO  (jetty-launcher-11860-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34945/solr
   [junit4]   2> 2512468 INFO  (jetty-launcher-11860-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34945/solr
   [junit4]   2> 2512468 INFO  (zkConnectionManagerCallback-11876-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512469 INFO  (zkConnectionManagerCallback-11878-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512469 INFO  (zkConnectionManagerCallback-11881-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512469 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160f2b620ac0004, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2512471 INFO  (zkConnectionManagerCallback-11884-thread-1-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512471 INFO  (zkConnectionManagerCallback-11885-thread-1-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512471 INFO  (zkConnectionManagerCallback-11887-thread-1-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512519 INFO  (jetty-launcher-11860-thread-1) [n:127.0.0.1:35949_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2512519 INFO  (jetty-launcher-11860-thread-3) [n:127.0.0.1:44321_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2512519 INFO  (jetty-launcher-11860-thread-2) [n:127.0.0.1:43861_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2512520 INFO  (jetty-launcher-11860-thread-1) [n:127.0.0.1:35949_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35949_solr
   [junit4]   2> 2512520 INFO  (jetty-launcher-11860-thread-2) [n:127.0.0.1:43861_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43861_solr
   [junit4]   2> 2512520 INFO  (jetty-launcher-11860-thread-3) [n:127.0.0.1:44321_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44321_solr
   [junit4]   2> 2512521 INFO  (jetty-launcher-11860-thread-1) [n:127.0.0.1:35949_solr    ] o.a.s.c.Overseer Overseer (id=99346055848263687-127.0.0.1:35949_solr-n_0000000000) starting
   [junit4]   2> 2512521 INFO  (zkCallback-11882-thread-1-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2512521 INFO  (zkCallback-11886-thread-1-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2512525 INFO  (jetty-launcher-11860-thread-1) [n:127.0.0.1:35949_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35949_solr
   [junit4]   2> 2512526 INFO  (zkCallback-11883-thread-1-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2512526 INFO  (zkCallback-11882-thread-1-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2512526 INFO  (zkCallback-11886-thread-1-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2512528 INFO  (zkCallback-11883-thread-1-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2512626 INFO  (jetty-launcher-11860-thread-3) [n:127.0.0.1:44321_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44321.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2512636 INFO  (jetty-launcher-11860-thread-3) [n:127.0.0.1:44321_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44321.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2512636 INFO  (jetty-launcher-11860-thread-3) [n:127.0.0.1:44321_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44321.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2512638 INFO  (jetty-launcher-11860-thread-3) [n:127.0.0.1:44321_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/tempDir-001/node3/.
   [junit4]   2> 2512680 INFO  (jetty-launcher-11860-thread-2) [n:127.0.0.1:43861_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43861.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2512700 INFO  (jetty-launcher-11860-thread-1) [n:127.0.0.1:35949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35949.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2512703 INFO  (jetty-launcher-11860-thread-2) [n:127.0.0.1:43861_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43861.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2512704 INFO  (jetty-launcher-11860-thread-2) [n:127.0.0.1:43861_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43861.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2512705 INFO  (jetty-launcher-11860-thread-2) [n:127.0.0.1:43861_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/tempDir-001/node2/.
   [junit4]   2> 2512710 INFO  (jetty-launcher-11860-thread-1) [n:127.0.0.1:35949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35949.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2512710 INFO  (jetty-launcher-11860-thread-1) [n:127.0.0.1:35949_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35949.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2512712 INFO  (jetty-launcher-11860-thread-1) [n:127.0.0.1:35949_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/tempDir-001/node1/.
   [junit4]   2> 2512768 INFO  (zkConnectionManagerCallback-11895-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512772 INFO  (zkConnectionManagerCallback-11899-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2512773 INFO  (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2512773 INFO  (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34945/solr ready
   [junit4]   2> 2512776 INFO  (qtp2625242-36528) [n:127.0.0.1:35949_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=1&replicationFactor=2&name=.system&nrtReplicas=2&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2512780 INFO  (OverseerThreadFactory-9801-thread-1-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.CreateCollectionCmd Create collection .system
   [junit4]   2> 2512885 INFO  (OverseerStateUpdate-99346055848263687-127.0.0.1:35949_solr-n_0000000000) [n:127.0.0.1:35949_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:35949/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 2512886 INFO  (OverseerStateUpdate-99346055848263687-127.0.0.1:35949_solr-n_0000000000) [n:127.0.0.1:35949_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:43861/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 2512887 INFO  (OverseerStateUpdate-99346055848263687-127.0.0.1:35949_solr-n_0000000000) [n:127.0.0.1:35949_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_p4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:44321/solr",
   [junit4]   2>   "type":"PULL",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 2513091 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2513091 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2513091 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_p4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=PULL
   [junit4]   2> 2513092 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2513092 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2513092 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2513199 INFO  (zkCallback-11883-thread-1-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2513199 INFO  (zkCallback-11886-thread-1-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2513199 INFO  (zkCallback-11886-thread-2-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2513199 INFO  (zkCallback-11882-thread-1-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2513199 INFO  (zkCallback-11883-thread-2-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2513199 INFO  (zkCallback-11882-thread-2-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2514105 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 2514105 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 2514107 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
   [junit4]   2> 2514124 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 2514124 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 2514126 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 2514129 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
   [junit4]   2> 2514130 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
   [junit4]   2> 2514132 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.IndexSchema [.system_shard1_replica_p4] Schema name=_system collection or core
   [junit4]   2> 2514133 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 2514134 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
   [junit4]   2> 2514135 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 2514135 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
   [junit4]   2> 2514136 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
   [junit4]   2> 2514136 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/.system/schema.xml no longer exists.
   [junit4]   2> 2514136 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from collection .system, trusted=true
   [junit4]   2> 2514136 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n2' using configuration from collection .system, trusted=true
   [junit4]   2> 2514136 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35949.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2514136 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43861.solr.core..system.shard1.replica_n2' (registry 'solr.core..system.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2514137 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2514137 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2514137 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/tempDir-001/node1/.system_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/tempDir-001/node1/./.system_shard1_replica_n1/data/]
   [junit4]   2> 2514137 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [[.system_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/tempDir-001/node2/.system_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/tempDir-001/node2/./.system_shard1_replica_n2/data/]
   [junit4]   2> 2514137 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 2514138 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
   [junit4]   2> 2514138 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/.system/schema.xml no longer exists.
   [junit4]   2> 2514138 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_p4' using configuration from collection .system, trusted=true
   [junit4]   2> 2514139 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44321.solr.core..system.shard1.replica_p4' (registry 'solr.core..system.shard1.replica_p4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2514139 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2514139 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore [[.system_shard1_replica_p4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/tempDir-001/node3/.system_shard1_replica_p4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/tempDir-001/node3/./.system_shard1_replica_p4/data/]
   [junit4]   2> 2514189 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2514189 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2514190 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
   [junit4]   2> 2514190 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2514192 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@19891f2[.system_shard1_replica_n1] main]
   [junit4]   2> 2514193 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
   [junit4]   2> 2514193 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2514193 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 2514194 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 2514194 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 2514194 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 2514195 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2514195 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.SolrIndexSearcher Opening [Searcher@1ec8be5[.system_shard1_replica_p4] main]
   [junit4]   2> 2514196 INFO  (searcherExecutor-9808-thread-1-processing-n:127.0.0.1:35949_solr x:.system_shard1_replica_n1 s:shard1 c:.system r:core_node3) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@19891f2[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2514196 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 2514196 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589536895512084480
   [junit4]   2> 2514196 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 2514196 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 2514197 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 2514201 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 2514201 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.IndexSchema [.system_shard1_replica_p4] Schema name=_system collection or core
   [junit4]   2> 2514225 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 2514225 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 27 ms
   [junit4]   2> 2514225 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2514225 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2514226 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2514227 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.ZkController .system_shard1_replica_p4 starting background replication from leader
   [junit4]   2> 2514227 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 2514227 INFO  (searcherExecutor-9810-thread-1-processing-n:127.0.0.1:44321_solr x:.system_shard1_replica_p4 s:shard1 c:.system r:core_node6) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@1ec8be5[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2514228 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
   [junit4]   2> 2514228 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2514229 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 2514229 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2514231 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@1579cf5[.system_shard1_replica_n2] main]
   [junit4]   2> 2514232 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 2514232 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 2514232 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 2514233 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 2514237 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
   [junit4]   2> 2514243 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 2514243 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 10 ms
   [junit4]   2> 2514244 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2514246 INFO  (searcherExecutor-9809-thread-1-processing-n:127.0.0.1:43861_solr x:.system_shard1_replica_n2 s:shard1 c:.system r:core_node5) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@1579cf5[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2514246 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1589536895564513280
   [junit4]   2> 2514302 INFO  (zkCallback-11883-thread-2-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2514302 INFO  (zkCallback-11882-thread-2-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2514302 INFO  (zkCallback-11883-thread-1-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2514302 INFO  (zkCallback-11886-thread-1-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2514302 INFO  (zkCallback-11886-thread-2-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2514302 INFO  (zkCallback-11882-thread-1-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2514701 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2514701 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2514701 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35949/solr/.system_shard1_replica_n1/
   [junit4]   2> 2514702 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n1 url=http://127.0.0.1:35949/solr START replicas=[http://127.0.0.1:43861/solr/.system_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 2514704 INFO  (qtp12782877-36529) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.S.Request [.system_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2515002 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n1 url=http://127.0.0.1:35949/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 2515003 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 2515003 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 2515003 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2515008 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35949/solr/.system_shard1_replica_n1/ shard1
   [junit4]   2> 2515109 INFO  (zkCallback-11883-thread-1-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2515109 INFO  (zkCallback-11886-thread-1-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2515109 INFO  (zkCallback-11883-thread-2-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2515109 INFO  (zkCallback-11886-thread-2-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2515110 INFO  (zkCallback-11882-thread-1-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2515110 INFO  (zkCallback-11882-thread-2-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2515159 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2515228 INFO  (qtp2625242-36516) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2137
   [junit4]   2> 2515231 INFO  (qtp26545010-36527) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_p4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=2140
   [junit4]   2> 2515252 INFO  (qtp12782877-36524) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2160
   [junit4]   2> 2515259 INFO  (qtp2625242-36528) [n:127.0.0.1:35949_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 2515308 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.IndexFetcher Replica core_node3 is leader but it's state is down, skipping replication
   [junit4]   2> 2515357 INFO  (zkCallback-11883-thread-1-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2515357 INFO  (zkCallback-11886-thread-1-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2515357 INFO  (zkCallback-11882-thread-2-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2515357 INFO  (zkCallback-11886-thread-2-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2515357 INFO  (zkCallback-11882-thread-1-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2515357 INFO  (zkCallback-11883-thread-2-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2516260 INFO  (qtp2625242-36528) [n:127.0.0.1:35949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=1&replicationFactor=2&name=.system&nrtReplicas=2&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3483
   [junit4]   2> 2516263 INFO  (qtp2625242-36533) [n:127.0.0.1:35949_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2516266 INFO  (qtp12782877-36513) [n:127.0.0.1:43861_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2516269 INFO  (qtp26545010-36532) [n:127.0.0.1:44321_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2516295 INFO  (TEST-TestClusterStateProvider.testAutoScalingConfig-seed#[AD8379163A9815C6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAutoScalingConfig
   [junit4]   2> 2516297 INFO  (TEST-TestClusterStateProvider.testAutoScalingConfig-seed#[AD8379163A9815C6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testAutoScalingConfig
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestClusterStateProvider -Dtests.method=testAutoScalingConfig -Dtests.seed=AD8379163A9815C6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es-VE -Dtests.timezone=America/Dominica -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.03s J2 | TestClusterStateProvider.testAutoScalingConfig <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
   [junit4]    >   "cluster-preferences":[{"maximize":"freedisk"}],
   [junit4]    >   "triggers":{".auto_add_replicas":{
   [junit4]    >       "name":".auto_add_replicas",
   [junit4]    >       "event":"nodeLost",
   [junit4]    >       "waitFor":30,
   [junit4]    >       "actions":[
   [junit4]    >         {
   [junit4]    >           "name":"auto_add_replicas_plan",
   [junit4]    >           "class":"solr.AutoAddReplicasPlanAction"},
   [junit4]    >         {
   [junit4]    >           "name":"execute_plan",
   [junit4]    >           "class":"solr.ExecutePlanAction"}],
   [junit4]    >       "enabled":true}},
   [junit4]    >   "listeners":{".auto_add_replicas.system":{
   [junit4]    >       "trigger":".auto_add_replicas",
   [junit4]    >       "afterAction":[],
   [junit4]    >       "stage":[
   [junit4]    >         "STARTED",
   [junit4]    >         "ABORTED",
   [junit4]    >         "SUCCEEDED",
   [junit4]    >         "FAILED",
   [junit4]    >         "BEFORE_ACTION",
   [junit4]    >         "AFTER_ACTION",
   [junit4]    >         "IGNORED"],
   [junit4]    >       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
   [junit4]    >       "beforeAction":[]}},
   [junit4]    >   "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
   [junit4]    >   "cluster-preferences":[{"maximize":"freedisk"}],
   [junit4]    >   "triggers":{".auto_add_replicas":{
   [junit4]    >       "name":".auto_add_replicas",
   [junit4]    >       "event":"nodeLost",
   [junit4]    >       "waitFor":30,
   [junit4]    >       "actions":[
   [junit4]    >         {
   [junit4]    >           "name":"auto_add_replicas_plan",
   [junit4]    >           "class":"solr.AutoAddReplicasPlanAction"},
   [junit4]    >         {
   [junit4]    >           "name":"execute_plan",
   [junit4]    >           "class":"solr.ExecutePlanAction"}],
   [junit4]    >       "enabled":true}},
   [junit4]    >   "listeners":{".auto_add_replicas.system":{
   [junit4]    >       "trigger":".auto_add_replicas",
   [junit4]    >       "afterAction":[],
   [junit4]    >       "stage":[
   [junit4]    >         "STARTED",
   [junit4]    >         "ABORTED",
   [junit4]    >         "SUCCEEDED",
   [junit4]    >         "FAILED",
   [junit4]    >         "BEFORE_ACTION",
   [junit4]    >         "AFTER_ACTION",
   [junit4]    >         "IGNORED"],
   [junit4]    >       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
   [junit4]    >       "beforeAction":[]}},
   [junit4]    >   "properties":{}}>
   [junit4]    > at __randomizedtesting.SeedInfo.seed([AD8379163A9815C6:920B7ABE2DCEE521]:0)
   [junit4]    > at org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig(TestClusterStateProvider.java:214)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2516325 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAddRemoveNode
   [junit4]   2> 2516326 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2516327 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3dcc1c{/solr,null,AVAILABLE}
   [junit4]   2> 2516328 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1aa8af4{HTTP/1.1,[http/1.1]}{127.0.0.1:40769}
   [junit4]   2> 2516328 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.e.j.s.Server Started @2517400ms
   [junit4]   2> 2516328 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40769}
   [junit4]   2> 2516328 ERROR (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2516328 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.3.0
   [junit4]   2> 2516328 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2516328 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2516328 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T03:28:34.362Z
   [junit4]   2> 2516330 INFO  (zkConnectionManagerCallback-11901-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2516331 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2516339 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34945/solr
   [junit4]   2> 2516340 INFO  (zkConnectionManagerCallback-11905-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2516342 INFO  (zkConnectionManagerCallback-11907-thread-1-processing-n:127.0.0.1:40769_solr) [n:127.0.0.1:40769_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2516345 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [n:127.0.0.1:40769_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2516346 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [n:127.0.0.1:40769_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2516347 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [n:127.0.0.1:40769_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40769_solr
   [junit4]   2> 2516348 INFO  (zkCallback-11883-thread-2-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2516348 INFO  (zkCallback-11886-thread-2-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2516348 INFO  (zkCallback-11882-thread-1-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2516348 INFO  (zkCallback-11898-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2516350 INFO  (zkCallback-11906-thread-1-processing-n:127.0.0.1:40769_solr) [n:127.0.0.1:40769_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2516603 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [n:127.0.0.1:40769_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40769.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2516614 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [n:127.0.0.1:40769_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40769.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2516615 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [n:127.0.0.1:40769_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40769.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c3125
   [junit4]   2> 2516616 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [n:127.0.0.1:40769_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001/tempDir-001/node4/.
   [junit4]   2> 2516782 INFO  (OverseerCollectionConfigSetProcessor-99346055848263687-127.0.0.1:35949_solr-n_0000000000) [n:127.0.0.1:35949_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2518308 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.IndexFetcher Last replication failed, so I'll force replication
   [junit4]   2> 2518308 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.IndexFetcher Updated masterUrl to http://127.0.0.1:35949/solr/.system_shard1_replica_n1/
   [junit4]   2> 2518310 INFO  (qtp2625242-36528) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.S.Request [.system_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 2518310 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 2518310 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 2518310 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 2518310 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 2518310 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 2518310 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2518310 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@ea6539 commitCommandVersion:0
   [junit4]   2> 2518311 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.s.SolrIndexSearcher Opening [Searcher@cf0442[.system_shard1_replica_p4] main]
   [junit4]   2> 2518311 INFO  (indexFetcher-9823-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2518313 INFO  (searcherExecutor-9810-thread-1-processing-n:127.0.0.1:44321_solr x:.system_shard1_replica_p4 s:shard1 c:.system r:core_node6) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@cf0442[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2518667 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1997688{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2518667 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=31539556
   [junit4]   2> 2518667 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2518668 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1458d3b: rootName = solr_44321, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@c74954
   [junit4]   2> 2518674 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2518674 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@176b74e: rootName = solr_44321, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@715421
   [junit4]   2> 2518679 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2518679 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1d34c5: rootName = solr_44321, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@16732b9
   [junit4]   2> 2518680 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:44321_solr
   [junit4]   2> 2518681 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 2518681 INFO  (zkCallback-11882-thread-1-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2518681 INFO  (zkCallback-11883-thread-2-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2518681 INFO  (zkCallback-11898-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2518681 INFO  (zkCallback-11883-thread-1-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2518682 INFO  (zkCallback-11886-thread-1-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2518682 INFO  (zkCallback-11882-thread-3-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2518682 INFO  (zkCallback-11883-thread-3-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2518682 INFO  (zkCallback-11882-thread-2-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2518682 INFO  (zkCallback-11886-thread-2-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2518682 INFO  (zkCallback-11886-thread-3-processing-n:127.0.0.1:44321_solr) [n:127.0.0.1:44321_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2518682 INFO  (zkCallback-11906-thread-1-processing-n:127.0.0.1:40769_solr) [n:127.0.0.1:40769_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 2518682 INFO  (coreCloseExecutor-9830-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.c.SolrCore [.system_shard1_replica_p4]  CLOSING SolrCore org.apache.solr.core.SolrCore@14efd0b
   [junit4]   2> 2518682 INFO  (coreCloseExecutor-9830-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core..system.shard1.replica_p4, tag=21953803
   [junit4]   2> 2518682 INFO  (coreCloseExecutor-9830-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@f79f8f: rootName = solr_44321, domain = solr.core..system.shard1.replica_p4, service url = null, agent id = null] for registry solr.core..system.shard1.replica_p4 / com.codahale.metrics.MetricRegistry@16e7f41
   [junit4]   2> 2518691 INFO  (coreCloseExecutor-9830-thread-1) [n:127.0.0.1:44321_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=21953803
   [junit4]   2> 2518693 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@9d76fe{/solr,null,UNAVAILABLE}
   [junit4]   2> 2520694 INFO  (TEST-TestClusterStateProvider.testAddRemoveNode-seed#[AD8379163A9815C6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testAddRemoveNode
   [junit4]   2> 2520696 INFO  (jetty-closer-11861-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@184c615{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2520696 INFO  (jetty-closer-11861-thread-3) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1aa8af4{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2520696 INFO  (jetty-closer-11861-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@69392b{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2520697 INFO  (jetty-closer-11861-thread-3) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=12627609
   [junit4]   2> 2520697 INFO  (jetty-closer-11861-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=11302514
   [junit4]   2> 2520696 INFO  (jetty-closer-11861-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=22771292
   [junit4]   2> 2520697 INFO  (jetty-closer-11861-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2520697 INFO  (jetty-closer-11861-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2520697 INFO  (jetty-closer-11861-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2520697 INFO  (jetty-closer-11861-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1a15215: rootName = solr_40769, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@c04f75
   [junit4]   2> 2520697 INFO  (jetty-closer-11861-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@99408c: rootName = solr_35949, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@5f3281
   [junit4]   2> 2520697 INFO  (jetty-closer-11861-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@a40839: rootName = solr_43861, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@674f3d
   [junit4]   2> 2520703 INFO  (jetty-closer-11861-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2520704 INFO  (jetty-closer-11861-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1d4c44c: rootName = solr_43861, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@715421
   [junit4]   2> 2520704 INFO  (jetty-closer-11861-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2520704 INFO  (jetty-closer-11861-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@91820b: rootName = solr_35949, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@715421
   [junit4]   2> 2520706 INFO  (jetty-closer-11861-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2520706 INFO  (jetty-closer-11861-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@f704e6: rootName = solr_40769, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@715421
   [junit4]   2> 2520727 INFO  (jetty-closer-11861-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2520727 INFO  (jetty-closer-11861-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5f4ccc: rootName = solr_43861, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@16732b9
   [junit4]   2> 2520727 INFO  (jetty-closer-11861-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2520727 INFO  (jetty-closer-11861-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1df23e5: rootName = solr_35949, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@16732b9
   [junit4]   2> 2520728 INFO  (jetty-closer-11861-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:43861_solr
   [junit4]   2> 2520729 INFO  (jetty-closer-11861-thread-2) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:35949_solr
   [junit4]   2> 2520729 INFO  (jetty-closer-11861-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 2520729 INFO  (zkCallback-11906-thread-1-processing-n:127.0.0.1:40769_solr) [n:127.0.0.1:40769_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 2520729 INFO  (zkCallback-11883-thread-3-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 2520729 INFO  (coreCloseExecutor-9832-thread-1) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [.system_shard1_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@165991e
   [junit4]   2> 2520729 INFO  (coreCloseExecutor-9832-thread-1) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core..system.shard1.replica_n2, tag=23435550
   [junit4]   2> 2520729 INFO  (coreCloseExecutor-9832-thread-1) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7b0321: rootName = solr_43861, domain = solr.core..system.shard1.replica_n2, service url = null, agent id = null] for registry solr.core..system.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@3723d0
   [junit4]   2> 2520730 INFO  (jetty-closer-11861-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 2520730 INFO  (zkCallback-11882-thread-2-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
   [junit4]   2> 2520730 INFO  (zkCallback-11883-thread-2-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 2520730 INFO  (coreCloseExecutor-9833-thread-1) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [.system_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1e9c900
   [junit4]   2> 2520730 INFO  (coreCloseExecutor-9833-thread-1) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core..system.shard1.replica_n1, tag=32098560
   [junit4]   2> 2520730 INFO  (coreCloseExecutor-9833-thread-1) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@170b47c: rootName = solr_35949, domain = solr.core..system.shard1.replica_n1, service url = null, agent id = null] for registry solr.core..system.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@7a89c6
   [junit4]   2> 2520731 INFO  (zkCallback-11883-thread-3-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2520731 INFO  (zkCallback-11882-thread-1-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2520731 INFO  (zkCallback-11882-thread-3-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2520731 INFO  (zkCallback-11883-thread-2-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2520732 INFO  (zkCallback-11906-thread-2-processing-n:127.0.0.1:40769_solr) [n:127.0.0.1:40769_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 252073

[...truncated too long message...]

, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@16732b9
   [junit4]   2> 2520736 INFO  (jetty-closer-11861-thread-3) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40769_solr
   [junit4]   2> 2520736 INFO  (zkCallback-11883-thread-2-processing-n:127.0.0.1:43861_solr) [n:127.0.0.1:43861_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 2520736 INFO  (jetty-closer-11861-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 2520736 INFO  (zkCallback-11906-thread-2-processing-n:127.0.0.1:40769_solr) [n:127.0.0.1:40769_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 2520736 INFO  (zkCallback-11882-thread-2-processing-n:127.0.0.1:35949_solr) [n:127.0.0.1:35949_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 2520737 INFO  (jetty-closer-11861-thread-3) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2520738 INFO  (jetty-closer-11861-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3dcc1c{/solr,null,UNAVAILABLE}
   [junit4]   2> 2520745 INFO  (coreCloseExecutor-9832-thread-1) [n:127.0.0.1:43861_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=23435550
   [junit4]   2> 2520746 INFO  (coreCloseExecutor-9833-thread-1) [n:127.0.0.1:35949_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=32098560
   [junit4]   2> 2520747 INFO  (jetty-closer-11861-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@d9b54e{/solr,null,UNAVAILABLE}
   [junit4]   2> 2520747 INFO  (jetty-closer-11861-thread-2) [    ] o.a.s.c.Overseer Overseer (id=99346055848263687-127.0.0.1:35949_solr-n_0000000000) closing
   [junit4]   2> 2520747 INFO  (OverseerStateUpdate-99346055848263687-127.0.0.1:35949_solr-n_0000000000) [n:127.0.0.1:35949_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:35949_solr
   [junit4]   2> 2520747 WARN  (OverseerAutoScalingTriggerThread-99346055848263687-127.0.0.1:35949_solr-n_0000000000) [n:127.0.0.1:35949_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 2520748 INFO  (jetty-closer-11861-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@e6a319{/solr,null,UNAVAILABLE}
   [junit4]   2> 2520749 ERROR (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2520749 INFO  (SUITE-TestClusterStateProvider-seed#[AD8379163A9815C6]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34945 34945
   [junit4]   2> 2532092 INFO  (Thread-7906) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34945 34945
   [junit4]   2> 2532093 WARN  (Thread-7906) [    ] o.a.s.c.ZkTestServer Watch limit violations:
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2>
   [junit4]   2> 5 /solr/aliases.json
   [junit4]   2> 5 /solr/clusterprops.json
   [junit4]   2> 4 /solr/security.json
   [junit4]   2> 3 /solr/configs/.system
   [junit4]   2> 3 /solr/configs/.system/managed-schema
   [junit4]   2>
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2>
   [junit4]   2> 23 /solr/collections/.system/state.json
   [junit4]   2> 5 /solr/clusterstate.json
   [junit4]   2> 2 /solr/overseer_elect/election/99346055848263687-127.0.0.1:35949_solr-n_0000000000
   [junit4]   2> 2 /solr/autoscaling.json
   [junit4]   2>
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2>
   [junit4]   2> 5 /solr/live_nodes
   [junit4]   2> 5 /solr/collections
   [junit4]   2>
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestClusterStateProvider_AD8379163A9815C6-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1796, maxMBSortInHeap=6.306408729668066, sim=RandomSimilarity(queryNorm=true): {}, locale=es-VE, timezone=America/Dominica
   [junit4]   2> NOTE: Linux 4.13.0-26-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=221853776,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrQueryResponse, TestMissingGroups, FieldAnalysisRequestHandlerTest, RequiredFieldsTest, TestLMDirichletSimilarityFactory, TestJsonFacetRefinement, LeaderElectionTest, TestCloudPivotFacet, DefaultValueUpdateProcessorTest, TestLRUCache, TestSolrCoreProperties, TestConfigSets, HttpTriggerListenerTest, TestCollectionAPIs, DistanceUnitsTest, DocValuesMissingTest, UniqFieldsUpdateProcessorFactoryTest, TestTestInjection, TestFiltering, TestXmlQParser, MoveReplicaHDFSTest, HdfsWriteToMultipleCollectionsTest, RuleEngineTest, TestFieldTypeResource, CoreAdminRequestStatusTest, CustomCollectionTest, JavabinLoaderTest, TestSQLHandler, DeleteStatusTest, SolrJmxReporterCloudTest, TimeRoutedAliasUpdateProcessorTest, BasicDistributedZk2Test, TestLegacyNumericUtils, DisMaxRequestHandlerTest, TestSearchPerf, ReturnFieldsTest, QueryElevationComponentTest, TimeZoneUtilsTest, AtomicUpdatesTest, TestConfigOverlay, TestLFUCache, AliasIntegrationTest, ComputePlanActionTest, TestInitQParser, TestSlowCompositeReaderWrapper, TestCoreContainer, CSVRequestHandlerTest, TestFreeTextSuggestions, TestManagedResourceStorage, PluginInfoTest, UnloadDistributedZkTest, SSLMigrationTest, SuggesterTest, TestNumericRangeQuery32, CollectionsAPIAsyncDistributedZkTest, ZkNodePropsTest, AddBlockUpdateTest, TestMiniSolrCloudClusterSSL, OverseerCollectionConfigSetProcessorTest, MigrateRouteKeyTest, TestShardHandlerFactory, DocValuesNotIndexedTest, TestCharFilters, SolrCloudReportersTest, MetricsHandlerTest, VersionInfoTest, CdcrRequestHandlerTest, MergeStrategyTest, ScriptEngineTest, BadComponentTest, DistribJoinFromCollectionTest, TestCSVResponseWriter, TestDynamicLoading, TestSolrConfigHandlerConcurrent, AutoAddReplicasIntegrationTest, NodeLostTriggerTest, IndexBasedSpellCheckerTest, SolrCloudExampleTest, TestScoreJoinQPNoScore, HdfsBasicDistributedZkTest, BlockDirectoryTest, TestQueryTypes, DataDrivenBlockJoinTest, TestCustomDocTransformer, DeleteNodeTest, TestSystemIdResolver, CloudMLTQParserTest, IndexSchemaTest, TestSegmentSorting, JSONWriterTest, TestFunctionQuery, TestAddFieldRealTimeGet, RecoveryAfterSoftCommitTest, ChaosMonkeyNothingIsSafeTest, TestRandomRequestDistribution, RequestLoggingTest, HdfsLockFactoryTest, TestFieldCollectionResource, HdfsRecoveryZkTest, RecoveryZkTest, CustomHighlightComponentTest, TestComputePlanAction, TestCollectionsAPIViaSolrCloudCluster, HdfsCollectionsAPIDistributedZkTest, TestSkipOverseerOperations, TestFieldCacheVsDocValues, TestPartialUpdateDeduplication, SuggesterWFSTTest, FacetPivotSmallTest, TestLeaderInitiatedRecoveryThread, SystemInfoHandlerTest, TestTolerantUpdateProcessorRandomCloud, TestTriggerIntegration, TestDistributedMissingSort, TestSchemaSimilarityResource, SolrCoreMetricManagerTest, SpellPossibilityIteratorTest, ShufflingReplicaListTransformerTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, DistributedQueryComponentCustomSortTest, TestLMJelinekMercerSimilarityFactory, TestSearcherReuse, TestManagedSchema, BasicDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, TestZkChroot, TestRandomDVFaceting, TestDistributedGrouping, TestHashPartitioner, DistributedSpellCheckComponentTest, TestRealTimeGet, TestReload, TestSolr4Spatial, SpellCheckComponentTest, TestGroupingSearch, BadIndexSchemaTest, TestSort, TestLazyCores, DistributedQueryElevationComponentTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, CoreAdminHandlerTest, TestCSVLoader, SchemaVersionSpecificBehaviorTest, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, StatelessScriptUpdateProcessorFactoryTest, TestRemoteStreaming, XsltUpdateRequestHandlerTest, CacheHeaderTest, TestQueryUtils, DirectSolrSpellCheckerTest, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, LoggingHandlerTest, UpdateRequestProcessorFactoryTest, JsonLoaderTest, TestPHPSerializedResponseWriter, PingRequestHandlerTest, HighlighterConfigTest, UpdateParamsTest, CopyFieldTest, TestMergePolicyConfig, TestDocSet, TestBinaryField, OutputWriterTest, ExternalFileFieldSortTest, TestPhraseSuggestions, SynonymTokenizerTest, EchoParamsTest, TestIBSimilarityFactory, ResourceLoaderTest, OpenExchangeRatesOrgProviderTest, TestFastLRUCache, DateMathParserTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, ClusterStateTest, TestUtils, UUIDFieldTest, CursorPagingTest, CollectionTooManyReplicasTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, DistributedQueueTest, HttpPartitionTest, MissingSegmentRecoveryTest, MultiThreadedOCPTest, ReplaceNodeTest, SolrXmlInZkTest, TestCloudJSONFacetJoinDomain, TestConfigSetsAPI, TestRebalanceLeaders, TestReplicaProperties, TestSizeLimitedDistributedMap, TestStressLiveNodes, TlogReplayBufferedWhileIndexingTest, TriLevelCompositeIdRoutingTest, ExecutePlanActionTest, MetricTriggerTest, TestPolicyCloud, TestClusterStateProvider]
   [junit4] Completed [581/766 (1!)] on J2 in 20.85s, 2 tests, 1 failure <<< FAILURES!

[...truncated 44505 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_144) - Build # 1176 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1176/
Java: 64bit/jdk1.8.0_144 -XX:-UseCompressedOops -XX:+UseSerialGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestPullReplicaErrorHandling

Error Message:
file handle leaks: [FileChannel(/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/index-SimpleFSDirectory-001/write.lock)]

Stack Trace:
java.lang.RuntimeException: file handle leaks: [FileChannel(/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/index-SimpleFSDirectory-001/write.lock)]
        at __randomizedtesting.SeedInfo.seed([2FF9D42CE6DDA6DF]:0)
        at org.apache.lucene.mockfile.LeakFS.onClose(LeakFS.java:63)
        at org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:77)
        at org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:78)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:228)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.Exception
        at org.apache.lucene.mockfile.LeakFS.onOpen(LeakFS.java:46)
        at org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:81)
        at org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:197)
        at org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:166)
        at java.nio.channels.FileChannel.open(FileChannel.java:287)
        at java.nio.channels.FileChannel.open(FileChannel.java:335)
        at org.apache.lucene.store.NativeFSLockFactory.obtainFSLock(NativeFSLockFactory.java:125)
        at org.apache.lucene.store.FSLockFactory.obtainLock(FSLockFactory.java:41)
        at org.apache.lucene.store.BaseDirectory.obtainLock(BaseDirectory.java:45)
        at org.apache.lucene.store.FilterDirectory.obtainLock(FilterDirectory.java:104)
        at org.apache.lucene.store.MockDirectoryWrapper.obtainLock(MockDirectoryWrapper.java:1049)
        at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:948)
        at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:119)
        at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:94)
        at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:257)
        at org.apache.solr.update.DefaultSolrCoreState.changeWriter(DefaultSolrCoreState.java:220)
        at org.apache.solr.update.DefaultSolrCoreState.openIndexWriter(DefaultSolrCoreState.java:245)
        at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:625)
        at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:345)
        at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:420)
        at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(ReplicationHandler.java:1159)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        ... 1 more


FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:32827/solr/MoveReplicaHDFSTest_failed_coll_true, https://127.0.0.1:36959/solr/MoveReplicaHDFSTest_failed_coll_true]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:32827/solr/MoveReplicaHDFSTest_failed_coll_true, https://127.0.0.1:36959/solr/MoveReplicaHDFSTest_failed_coll_true]
        at __randomizedtesting.SeedInfo.seed([2FF9D42CE6DDA6DF:853407DE510E730F]:0)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:462)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1104)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:991)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
        at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:306)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:36959/solr/MoveReplicaHDFSTest_failed_coll_true: no servers hosting shard: shard1
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:436)
        ... 46 more


FAILED:  org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig

Error Message:
expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{   "cluster-preferences":[{"maximize":"freedisk"}],   "triggers":{".auto_add_replicas":{       "name":".auto_add_replicas",       "event":"nodeLost",       "waitFor":30,       "actions":[         {           "name":"auto_add_replicas_plan",           "class":"solr.AutoAddReplicasPlanAction"},         {           "name":"execute_plan",           "class":"solr.ExecutePlanAction"}],       "enabled":true}},   "listeners":{".auto_add_replicas.system":{       "trigger":".auto_add_replicas",       "afterAction":[],       "stage":[         "STARTED",         "ABORTED",         "SUCCEEDED",         "FAILED",         "BEFORE_ACTION",         "AFTER_ACTION",         "IGNORED"],       "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",       "beforeAction":[]}},   "properties":{}}>

Stack Trace:
java.lang.AssertionError: expected: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}> but was: org.apache.solr.client.solrj.cloud.autoscaling.AutoScalingConfig<{
  "cluster-preferences":[{"maximize":"freedisk"}],
  "triggers":{".auto_add_replicas":{
      "name":".auto_add_replicas",
      "event":"nodeLost",
      "waitFor":30,
      "actions":[
        {
          "name":"auto_add_replicas_plan",
          "class":"solr.AutoAddReplicasPlanAction"},
        {
          "name":"execute_plan",
          "class":"solr.ExecutePlanAction"}],
      "enabled":true}},
  "listeners":{".auto_add_replicas.system":{
      "trigger":".auto_add_replicas",
      "afterAction":[],
      "stage":[
        "STARTED",
        "ABORTED",
        "SUCCEEDED",
        "FAILED",
        "BEFORE_ACTION",
        "AFTER_ACTION",
        "IGNORED"],
      "class":"org.apache.solr.cloud.autoscaling.SystemLogListener",
      "beforeAction":[]}},
  "properties":{}}>
        at __randomizedtesting.SeedInfo.seed([2FF9D42CE6DDA6DF:1071D784F18B5638]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at org.apache.solr.cloud.autoscaling.sim.TestClusterStateProvider.testAutoScalingConfig(TestClusterStateProvider.java:214)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12207 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestPullReplicaErrorHandling
   [junit4]   2> 487018 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/init-core-data-001
   [junit4]   2> 487018 WARN  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=57 numCloses=57
   [junit4]   2> 487018 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 487019 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 487020 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/tempDir-001
   [junit4]   2> 487020 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 487020 INFO  (Thread-689) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 487020 INFO  (Thread-689) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 487022 ERROR (Thread-689) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 487120 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:34849
   [junit4]   2> 487131 INFO  (zkConnectionManagerCallback-670-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487135 INFO  (jetty-launcher-667-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 487135 INFO  (jetty-launcher-667-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 487135 INFO  (jetty-launcher-667-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 487136 INFO  (jetty-launcher-667-thread-4) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 487159 INFO  (jetty-launcher-667-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@37b04516{/solr,null,AVAILABLE}
   [junit4]   2> 487171 INFO  (jetty-launcher-667-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@da8ed2{HTTP/1.1,[http/1.1]}{127.0.0.1:35389}
   [junit4]   2> 487171 INFO  (jetty-launcher-667-thread-2) [    ] o.e.j.s.Server Started @488621ms
   [junit4]   2> 487171 INFO  (jetty-launcher-667-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35389}
   [junit4]   2> 487172 ERROR (jetty-launcher-667-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 487172 INFO  (jetty-launcher-667-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 487172 INFO  (jetty-launcher-667-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 487172 INFO  (jetty-launcher-667-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 487172 INFO  (jetty-launcher-667-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T08:04:50.667Z
   [junit4]   2> 487173 INFO  (jetty-launcher-667-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@f9d8b9a{/solr,null,AVAILABLE}
   [junit4]   2> 487173 INFO  (jetty-launcher-667-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3c41ba8b{/solr,null,AVAILABLE}
   [junit4]   2> 487173 INFO  (jetty-launcher-667-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@37b74ed0{/solr,null,AVAILABLE}
   [junit4]   2> 487173 INFO  (jetty-launcher-667-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5d7f33ef{HTTP/1.1,[http/1.1]}{127.0.0.1:44783}
   [junit4]   2> 487173 INFO  (jetty-launcher-667-thread-4) [    ] o.e.j.s.Server Started @488623ms
   [junit4]   2> 487173 INFO  (jetty-launcher-667-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44783}
   [junit4]   2> 487174 INFO  (jetty-launcher-667-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@150d6d18{HTTP/1.1,[http/1.1]}{127.0.0.1:34883}
   [junit4]   2> 487174 INFO  (jetty-launcher-667-thread-1) [    ] o.e.j.s.Server Started @488623ms
   [junit4]   2> 487174 INFO  (jetty-launcher-667-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34883}
   [junit4]   2> 487174 ERROR (jetty-launcher-667-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 487181 ERROR (jetty-launcher-667-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 487181 INFO  (jetty-launcher-667-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 487182 INFO  (jetty-launcher-667-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 487182 INFO  (jetty-launcher-667-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 487182 INFO  (jetty-launcher-667-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T08:04:50.677Z
   [junit4]   2> 487182 INFO  (jetty-launcher-667-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 487182 INFO  (zkConnectionManagerCallback-672-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487182 INFO  (jetty-launcher-667-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 487182 INFO  (jetty-launcher-667-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 487182 INFO  (jetty-launcher-667-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T08:04:50.677Z
   [junit4]   2> 487182 INFO  (jetty-launcher-667-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 487205 INFO  (jetty-launcher-667-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6a3c0eff{HTTP/1.1,[http/1.1]}{127.0.0.1:36753}
   [junit4]   2> 487205 INFO  (jetty-launcher-667-thread-3) [    ] o.e.j.s.Server Started @488655ms
   [junit4]   2> 487205 INFO  (jetty-launcher-667-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36753}
   [junit4]   2> 487205 ERROR (jetty-launcher-667-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 487205 INFO  (jetty-launcher-667-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 487206 INFO  (jetty-launcher-667-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 487206 INFO  (jetty-launcher-667-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 487206 INFO  (jetty-launcher-667-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T08:04:50.701Z
   [junit4]   2> 487208 INFO  (zkConnectionManagerCallback-676-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487209 INFO  (jetty-launcher-667-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 487210 INFO  (zkConnectionManagerCallback-674-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487210 INFO  (jetty-launcher-667-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 487218 INFO  (jetty-launcher-667-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34849/solr
   [junit4]   2> 487221 INFO  (zkConnectionManagerCallback-678-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487222 INFO  (jetty-launcher-667-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 487234 INFO  (zkConnectionManagerCallback-682-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487245 INFO  (jetty-launcher-667-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34849/solr
   [junit4]   2> 487255 INFO  (jetty-launcher-667-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34849/solr
   [junit4]   2> 487281 INFO  (zkConnectionManagerCallback-687-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487288 INFO  (jetty-launcher-667-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34849/solr
   [junit4]   2> 487288 INFO  (zkConnectionManagerCallback-692-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487281 INFO  (zkConnectionManagerCallback-689-thread-1-processing-n:127.0.0.1:35389_solr) [n:127.0.0.1:35389_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487329 INFO  (zkConnectionManagerCallback-696-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487361 INFO  (zkConnectionManagerCallback-698-thread-1-processing-n:127.0.0.1:44783_solr) [n:127.0.0.1:44783_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487369 INFO  (zkConnectionManagerCallback-700-thread-1-processing-n:127.0.0.1:34883_solr) [n:127.0.0.1:34883_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487375 INFO  (zkConnectionManagerCallback-703-thread-1-processing-n:127.0.0.1:36753_solr) [n:127.0.0.1:36753_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487382 INFO  (jetty-launcher-667-thread-1) [n:127.0.0.1:34883_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 487389 INFO  (jetty-launcher-667-thread-1) [n:127.0.0.1:34883_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34883_solr
   [junit4]   2> 487390 INFO  (jetty-launcher-667-thread-1) [n:127.0.0.1:34883_solr    ] o.a.s.c.Overseer Overseer (id=99347142444056587-127.0.0.1:34883_solr-n_0000000000) starting
   [junit4]   2> 487408 INFO  (jetty-launcher-667-thread-4) [n:127.0.0.1:44783_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 487409 INFO  (jetty-launcher-667-thread-4) [n:127.0.0.1:44783_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44783_solr
   [junit4]   2> 487409 INFO  (jetty-launcher-667-thread-3) [n:127.0.0.1:36753_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 487411 INFO  (jetty-launcher-667-thread-3) [n:127.0.0.1:36753_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36753_solr
   [junit4]   2> 487423 INFO  (jetty-launcher-667-thread-2) [n:127.0.0.1:35389_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 487424 INFO  (jetty-launcher-667-thread-2) [n:127.0.0.1:35389_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 487425 INFO  (jetty-launcher-667-thread-2) [n:127.0.0.1:35389_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35389_solr
   [junit4]   2> 487447 INFO  (zkCallback-688-thread-1-processing-n:127.0.0.1:35389_solr) [n:127.0.0.1:35389_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 487465 INFO  (zkCallback-702-thread-1-processing-n:127.0.0.1:36753_solr) [n:127.0.0.1:36753_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 487473 INFO  (OverseerStateUpdate-99347142444056587-127.0.0.1:34883_solr-n_0000000000) [n:127.0.0.1:34883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 487474 INFO  (jetty-launcher-667-thread-1) [n:127.0.0.1:34883_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34883_solr
   [junit4]   2> 487474 INFO  (zkCallback-702-thread-1-processing-n:127.0.0.1:36753_solr) [n:127.0.0.1:36753_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 487489 INFO  (zkCallback-699-thread-1-processing-n:127.0.0.1:34883_solr) [n:127.0.0.1:34883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 487492 INFO  (zkCallback-688-thread-1-processing-n:127.0.0.1:35389_solr) [n:127.0.0.1:35389_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 487499 INFO  (zkCallback-697-thread-1-processing-n:127.0.0.1:44783_solr) [n:127.0.0.1:44783_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 487545 INFO  (zkCallback-697-thread-2-processing-n:127.0.0.1:44783_solr) [n:127.0.0.1:44783_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 487550 INFO  (jetty-launcher-667-thread-3) [n:127.0.0.1:36753_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36753.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487561 INFO  (jetty-launcher-667-thread-3) [n:127.0.0.1:36753_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36753.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487561 INFO  (jetty-launcher-667-thread-3) [n:127.0.0.1:36753_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36753.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487562 INFO  (jetty-launcher-667-thread-3) [n:127.0.0.1:36753_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/tempDir-001/node3/.
   [junit4]   2> 487670 INFO  (jetty-launcher-667-thread-4) [n:127.0.0.1:44783_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44783.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487671 INFO  (jetty-launcher-667-thread-2) [n:127.0.0.1:35389_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35389.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487678 INFO  (jetty-launcher-667-thread-4) [n:127.0.0.1:44783_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44783.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487678 INFO  (jetty-launcher-667-thread-4) [n:127.0.0.1:44783_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44783.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487679 INFO  (jetty-launcher-667-thread-2) [n:127.0.0.1:35389_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35389.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487679 INFO  (jetty-launcher-667-thread-2) [n:127.0.0.1:35389_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35389.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487680 INFO  (jetty-launcher-667-thread-2) [n:127.0.0.1:35389_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/tempDir-001/node2/.
   [junit4]   2> 487681 INFO  (jetty-launcher-667-thread-4) [n:127.0.0.1:44783_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/tempDir-001/node4/.
   [junit4]   2> 487761 INFO  (jetty-launcher-667-thread-1) [n:127.0.0.1:34883_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34883.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487770 INFO  (jetty-launcher-667-thread-1) [n:127.0.0.1:34883_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34883.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487770 INFO  (jetty-launcher-667-thread-1) [n:127.0.0.1:34883_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34883.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 487771 INFO  (jetty-launcher-667-thread-1) [n:127.0.0.1:34883_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/tempDir-001/node1/.
   [junit4]   2> 487879 INFO  (zkConnectionManagerCallback-712-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487889 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160f3b31ed4000d, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 487910 INFO  (zkConnectionManagerCallback-716-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 487911 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 487912 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34849/solr ready
   [junit4]   2> 487920 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@6a3c0eff{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 487921 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=996670193
   [junit4]   2> 487921 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 487921 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@371122e5: rootName = solr_36753, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@74b64e6b
   [junit4]   2> 487929 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 487929 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@50438d81: rootName = solr_36753, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7eb2877a
   [junit4]   2> 487934 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 487934 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@96545b1: rootName = solr_36753, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6ec93600
   [junit4]   2> 487935 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36753_solr
   [junit4]   2> 487938 INFO  (zkCallback-688-thread-1-processing-n:127.0.0.1:35389_solr) [n:127.0.0.1:35389_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 487938 INFO  (zkCallback-699-thread-1-processing-n:127.0.0.1:34883_solr) [n:127.0.0.1:34883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 487938 INFO  (zkCallback-702-thread-1-processing-n:127.0.0.1:36753_solr) [n:127.0.0.1:36753_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 487939 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 487949 INFO  (zkCallback-697-thread-2-processing-n:127.0.0.1:44783_solr) [n:127.0.0.1:44783_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 487950 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 487952 INFO  (zkCallback-715-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 487953 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@f9d8b9a{/solr,null,UNAVAILABLE}
   [junit4]   2> 487954 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 488002 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@26ab9d9e{/solr,null,AVAILABLE}
   [junit4]   2> 488003 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2616cd3d{HTTP/1.1,[http/1.1]}{127.0.0.1:38679}
   [junit4]   2> 488003 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.Server Started @489453ms
   [junit4]   2> 488003 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42167}
   [junit4]   2> 488003 ERROR (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 488014 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 488017 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 488017 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 488017 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T08:04:51.512Z
   [junit4]   2> 488025 INFO  (zkConnectionManagerCallback-718-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 488026 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 488036 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34849/solr
   [junit4]   2> 488053 INFO  (zkConnectionManagerCallback-722-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 488076 INFO  (zkConnectionManagerCallback-724-thread-1-processing-n:127.0.0.1:42167_solr) [n:127.0.0.1:42167_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 488079 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42167_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 488080 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42167_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 488081 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42167_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42167_solr
   [junit4]   2> 488082 INFO  (zkCallback-715-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488082 INFO  (zkCallback-688-thread-1-processing-n:127.0.0.1:35389_solr) [n:127.0.0.1:35389_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488082 INFO  (zkCallback-697-thread-2-processing-n:127.0.0.1:44783_solr) [n:127.0.0.1:44783_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488082 INFO  (zkCallback-699-thread-1-processing-n:127.0.0.1:34883_solr) [n:127.0.0.1:34883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488085 INFO  (zkCallback-723-thread-1-processing-n:127.0.0.1:42167_solr) [n:127.0.0.1:42167_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488194 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42167_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42167.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 488204 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42167_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42167.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 488204 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42167_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42167.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 488205 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42167_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/tempDir-001/node3/.
   [junit4]   2> 488260 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: http://127.0.0.1:38679/solr. Proxy: http://127.0.0.1:42167/solr
   [junit4]   2> 488261 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@da8ed2{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 488272 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=444239500
   [junit4]   2> 488272 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 488273 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3c312d85: rootName = solr_35389, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@7ffb3348
   [junit4]   2> 488280 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 488280 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2bef4191: rootName = solr_35389, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7eb2877a
   [junit4]   2> 488285 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 488285 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@a5d38ab: rootName = solr_35389, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6ec93600
   [junit4]   2> 488286 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:35389_solr
   [junit4]   2> 488287 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 488287 INFO  (zkCallback-697-thread-2-processing-n:127.0.0.1:44783_solr) [n:127.0.0.1:44783_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 488288 INFO  (zkCallback-699-thread-1-processing-n:127.0.0.1:34883_solr) [n:127.0.0.1:34883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 488288 INFO  (zkCallback-715-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 488288 INFO  (zkCallback-723-thread-1-processing-n:127.0.0.1:42167_solr) [n:127.0.0.1:42167_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 488290 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 488290 INFO  (zkCallback-688-thread-1-processing-n:127.0.0.1:35389_solr) [n:127.0.0.1:35389_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 488291 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@37b04516{/solr,null,UNAVAILABLE}
   [junit4]   2> 488292 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 488317 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6701b61a{/solr,null,AVAILABLE}
   [junit4]   2> 488317 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6330b504{HTTP/1.1,[http/1.1]}{127.0.0.1:44585}
   [junit4]   2> 488318 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.Server Started @489767ms
   [junit4]   2> 488318 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38395}
   [junit4]   2> 488318 ERROR (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 488318 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 488318 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 488318 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 488318 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T08:04:51.813Z
   [junit4]   2> 488344 INFO  (zkConnectionManagerCallback-728-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 488345 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 488366 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34849/solr
   [junit4]   2> 488380 INFO  (zkConnectionManagerCallback-732-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 488393 INFO  (zkConnectionManagerCallback-734-thread-1-processing-n:127.0.0.1:38395_solr) [n:127.0.0.1:38395_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 488402 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:38395_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 488406 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:38395_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 488417 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:38395_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38395_solr
   [junit4]   2> 488418 INFO  (zkCallback-723-thread-1-processing-n:127.0.0.1:42167_solr) [n:127.0.0.1:42167_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488418 INFO  (zkCallback-699-thread-1-processing-n:127.0.0.1:34883_solr) [n:127.0.0.1:34883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488425 INFO  (zkCallback-697-thread-2-processing-n:127.0.0.1:44783_solr) [n:127.0.0.1:44783_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488425 INFO  (zkCallback-715-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488429 INFO  (zkCallback-733-thread-1-processing-n:127.0.0.1:38395_solr) [n:127.0.0.1:38395_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488584 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:38395_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38395.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 488594 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:38395_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38395.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 488594 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:38395_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38395.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 488596 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:38395_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/tempDir-001/node2/.
   [junit4]   2> 488682 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: http://127.0.0.1:44585/solr. Proxy: http://127.0.0.1:38395/solr
   [junit4]   2> 488683 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@5d7f33ef{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 488684 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1429528826
   [junit4]   2> 488684 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 488685 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@76739008: rootName = solr_44783, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@4de39a01
   [junit4]   2> 488691 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 488692 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@46002ff4: rootName = solr_44783, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7eb2877a
   [junit4]   2> 488696 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 488697 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@60efee48: rootName = solr_44783, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6ec93600
   [junit4]   2> 488699 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:44783_solr
   [junit4]   2> 488700 INFO  (zkCallback-723-thread-1-processing-n:127.0.0.1:42167_solr) [n:127.0.0.1:42167_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 488700 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 488701 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 488702 INFO  (zkCallback-733-thread-1-processing-n:127.0.0.1:38395_solr) [n:127.0.0.1:38395_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 488702 INFO  (zkCallback-699-thread-1-processing-n:127.0.0.1:34883_solr) [n:127.0.0.1:34883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 488702 INFO  (zkCallback-715-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 488702 INFO  (zkCallback-697-thread-2-processing-n:127.0.0.1:44783_solr) [n:127.0.0.1:44783_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 488706 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3c41ba8b{/solr,null,UNAVAILABLE}
   [junit4]   2> 488707 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 488713 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6a98f06c{/solr,null,AVAILABLE}
   [junit4]   2> 488714 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@791c00b2{HTTP/1.1,[http/1.1]}{127.0.0.1:38867}
   [junit4]   2> 488714 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.Server Started @490163ms
   [junit4]   2> 488714 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42371}
   [junit4]   2> 488714 ERROR (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 488714 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 488714 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 488714 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 488714 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T08:04:52.209Z
   [junit4]   2> 488722 INFO  (zkConnectionManagerCallback-738-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 488722 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 488755 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34849/solr
   [junit4]   2> 488774 INFO  (zkConnectionManagerCallback-742-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 488787 INFO  (zkConnectionManagerCallback-744-thread-1-processing-n:127.0.0.1:42371_solr) [n:127.0.0.1:42371_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 488817 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42371_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 488822 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42371_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 488824 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42371_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42371_solr
   [junit4]   2> 488825 INFO  (zkCallback-715-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488825 INFO  (zkCallback-733-thread-1-processing-n:127.0.0.1:38395_solr) [n:127.0.0.1:38395_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488826 INFO  (zkCallback-723-thread-2-processing-n:127.0.0.1:42167_solr) [n:127.0.0.1:42167_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488826 INFO  (zkCallback-699-thread-1-processing-n:127.0.0.1:34883_solr) [n:127.0.0.1:34883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488852 INFO  (zkCallback-743-thread-1-processing-n:127.0.0.1:42371_solr) [n:127.0.0.1:42371_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 488924 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42371_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42371.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 488934 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42371_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42371.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 488934 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42371_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42371.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 488936 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:42371_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/tempDir-001/node4/.
   [junit4]   2> 488993 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: http://127.0.0.1:38867/solr. Proxy: http://127.0.0.1:42371/solr
   [junit4]   2> 488995 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@150d6d18{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 488996 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=688463613
   [junit4]   2> 488997 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 488997 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7c652a59: rootName = solr_34883, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@23bceea8
   [junit4]   2> 489005 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 489006 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@638b6df2: rootName = solr_34883, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7eb2877a
   [junit4]   2> 489011 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 489011 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@e1b738b: rootName = solr_34883, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6ec93600
   [junit4]   2> 489015 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:34883_solr
   [junit4]   2> 489016 INFO  (zkCallback-723-thread-2-processing-n:127.0.0.1:42167_solr) [n:127.0.0.1:42167_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 489016 INFO  (zkCallback-743-thread-1-processing-n:127.0.0.1:42371_solr) [n:127.0.0.1:42371_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 489016 INFO  (zkCallback-715-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 489016 INFO  (zkCallback-733-thread-1-processing-n:127.0.0.1:38395_solr) [n:127.0.0.1:38395_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 489017 INFO  (zkCallback-699-thread-1-processing-n:127.0.0.1:34883_solr) [n:127.0.0.1:34883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 489017 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 489017 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 489017 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.Overseer Overseer (id=99347142444056587-127.0.0.1:34883_solr-n_0000000000) closing
   [junit4]   2> 489017 INFO  (OverseerStateUpdate-99347142444056587-127.0.0.1:34883_solr-n_0000000000) [n:127.0.0.1:34883_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34883_solr
   [junit4]   2> 489044 WARN  (OverseerAutoScalingTriggerThread-99347142444056587-127.0.0.1:34883_solr-n_0000000000) [n:127.0.0.1:34883_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 489050 INFO  (zkCallback-723-thread-2-processing-n:127.0.0.1:42167_solr) [n:127.0.0.1:42167_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42167_solr
   [junit4]   2> 489051 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@37b74ed0{/solr,null,UNAVAILABLE}
   [junit4]   2> 489051 INFO  (zkCallback-723-thread-2-processing-n:127.0.0.1:42167_solr) [n:127.0.0.1:42167_solr    ] o.a.s.c.Overseer Overseer (id=99347142444056593-127.0.0.1:42167_solr-n_0000000004) starting
   [junit4]   2> 489058 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 489105 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e825060{/solr,null,AVAILABLE}
   [junit4]   2> 489105 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5ab56ddb{HTTP/1.1,[http/1.1]}{127.0.0.1:43683}
   [junit4]   2> 489105 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.e.j.s.Server Started @490555ms
   [junit4]   2> 489105 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43531}
   [junit4]   2> 489106 ERROR (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 489112 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.3.0
   [junit4]   2> 489121 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 489121 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 489121 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-01-14T08:04:52.616Z
   [junit4]   2> 489139 INFO  (zkConnectionManagerCallback-748-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 489140 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 489146 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34849/solr
   [junit4]   2> 489147 INFO  (zkConnectionManagerCallback-752-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 489150 INFO  (zkConnectionManagerCallback-754-thread-1-processing-n:127.0.0.1:43531_solr) [n:127.0.0.1:43531_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 489153 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:43531_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 489154 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:43531_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 489155 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:43531_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43531_solr
   [junit4]   2> 489155 INFO  (zkCallback-715-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 489155 INFO  (zkCallback-723-thread-2-processing-n:127.0.0.1:42167_solr) [n:127.0.0.1:42167_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 489155 INFO  (zkCallback-743-thread-1-processing-n:127.0.0.1:42371_solr) [n:127.0.0.1:42371_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 489155 INFO  (zkCallback-733-thread-1-processing-n:127.0.0.1:38395_solr) [n:127.0.0.1:38395_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 489183 INFO  (zkCallback-753-thread-1-processing-n:127.0.0.1:43531_solr) [n:127.0.0.1:43531_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 489236 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:43531_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43531.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 489248 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:43531_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43531.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 489248 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:43531_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43531.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f830b23
   [junit4]   2> 489249 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [n:127.0.0.1:43531_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestPullReplicaErrorHandling_2FF9D42CE6DDA6DF-001/tempDir-001/node1/.
   [junit4]   2> 489340 INFO  (SUITE-TestPullReplicaErrorHandling-seed#[2FF9D42CE6DDA6DF]-worker) [    ] o.a.s.c.TestPullReplicaErrorHandling Adding proxy for URL: http://127.0.0.1:43683/solr. Proxy: http://127.0.0.1:43531/solr
   [junit4]   2> 489343 INFO  (SocketProxy-Acceptor-38395) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=43510,localport=38395], receiveBufferSize:531000
   [junit4]   2> 489349 INFO  (SocketProxy-Acceptor-38395) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44585,localport=47382], receiveBufferSize=530904
   [junit4]   2> 489363 INFO  (qtp1616976158-3557) [n:127.0.0.1:38395_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 489366 INFO  (qtp1616976158-3557) [n:127.0.0.1:38395_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 489438 INFO  (TEST-TestPullReplicaErrorHandling.testCantConnectToPullReplica-seed#[2FF9D42CE6DDA6DF]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCantConnectToPullReplica
   [junit4]   2> 489439 INFO  (qtp1616976158-3558) [n:127.0.0.1:38395_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=1&replicationFactor=1&collection.configName=conf&maxShardsPerNode=1&name=pull_replica_error_handling_test_cant_connect_to_pull_replica&nrtReplicas=1&action=CREATE&numShards=2&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 489445 INFO  (OverseerThreadFactory-1456-thread-1-processing-n:127.0.0.1:42167_solr) [n:127.0.0.1:42167_solr    ] o.a.s.c.CreateCollectionCmd Create collection pull_replica_error_handling_test_cant_connect_to_pull_replica
   [junit4]   2> 489557 INFO  (OverseerStateUpdate-99347142444056593-127.0.0.1:42167_solr-n_0000000004) [n:127.0.0.1:42167_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"pull_replica_error_handling_test_cant_connect_to_pull_replica",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"pull_replica_error_handl