[JENKINS] Lucene-Solr-8.x-Solaris (64bit/jdk1.8.0) - Build # 37 - Unstable!

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-8.x-Solaris (64bit/jdk1.8.0) - Build # 37 - Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Solaris/37/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.solr.cloud.DistributedVersionInfoTest.testReplicaVersionHandling

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([29D534D650B0A5CC]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.DistributedVersionInfoTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([29D534D650B0A5CC]:0)




Build Log:
[...truncated 16631 lines...]
   [junit4] Suite: org.apache.solr.cloud.DistributedVersionInfoTest
   [junit4]   2> 2064602 INFO  (SUITE-DistributedVersionInfoTest-seed#[29D534D650B0A5CC]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/init-core-data-001
   [junit4]   2> 2064603 WARN  (SUITE-DistributedVersionInfoTest-seed#[29D534D650B0A5CC]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 2064603 INFO  (SUITE-DistributedVersionInfoTest-seed#[29D534D650B0A5CC]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2064605 INFO  (SUITE-DistributedVersionInfoTest-seed#[29D534D650B0A5CC]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 2064605 INFO  (SUITE-DistributedVersionInfoTest-seed#[29D534D650B0A5CC]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001
   [junit4]   2> 2064605 INFO  (SUITE-DistributedVersionInfoTest-seed#[29D534D650B0A5CC]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2064606 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2064606 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2064706 INFO  (SUITE-DistributedVersionInfoTest-seed#[29D534D650B0A5CC]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:58635
   [junit4]   2> 2064706 INFO  (SUITE-DistributedVersionInfoTest-seed#[29D534D650B0A5CC]-worker) [    ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:58635
   [junit4]   2> 2064706 INFO  (SUITE-DistributedVersionInfoTest-seed#[29D534D650B0A5CC]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 58635
   [junit4]   2> 2064718 INFO  (zkConnectionManagerCallback-11149-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2064727 INFO  (zkConnectionManagerCallback-11151-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2064736 INFO  (zkConnectionManagerCallback-11153-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2064739 WARN  (jetty-launcher-11154-thread-1) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2064739 WARN  (jetty-launcher-11154-thread-3) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2064739 INFO  (jetty-launcher-11154-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 2064739 INFO  (jetty-launcher-11154-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 2064739 INFO  (jetty-launcher-11154-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2064739 INFO  (jetty-launcher-11154-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2064739 INFO  (jetty-launcher-11154-thread-3) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12
   [junit4]   2> 2064739 INFO  (jetty-launcher-11154-thread-1) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12
   [junit4]   2> 2064740 WARN  (jetty-launcher-11154-thread-2) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2064740 INFO  (jetty-launcher-11154-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2064740 INFO  (jetty-launcher-11154-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2064740 INFO  (jetty-launcher-11154-thread-3) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2064740 INFO  (jetty-launcher-11154-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 2064740 INFO  (jetty-launcher-11154-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2064740 INFO  (jetty-launcher-11154-thread-2) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12
   [junit4]   2> 2064740 INFO  (jetty-launcher-11154-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@38159c8b{/solr,null,AVAILABLE}
   [junit4]   2> 2064741 INFO  (jetty-launcher-11154-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2064741 INFO  (jetty-launcher-11154-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2064741 INFO  (jetty-launcher-11154-thread-2) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 2064741 INFO  (jetty-launcher-11154-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6b7d1b44{/solr,null,AVAILABLE}
   [junit4]   2> 2064742 INFO  (jetty-launcher-11154-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2064742 INFO  (jetty-launcher-11154-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2064742 INFO  (jetty-launcher-11154-thread-1) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2064742 INFO  (jetty-launcher-11154-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6a9a48b8{/solr,null,AVAILABLE}
   [junit4]   2> 2064742 INFO  (jetty-launcher-11154-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@26cee536{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:52133}
   [junit4]   2> 2064742 INFO  (jetty-launcher-11154-thread-3) [    ] o.e.j.s.Server Started @2066675ms
   [junit4]   2> 2064742 INFO  (jetty-launcher-11154-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52133}
   [junit4]   2> 2064743 ERROR (jetty-launcher-11154-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-02-10T16:13:37.242Z
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@11e1af77{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:37006}
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-2) [    ] o.e.j.s.Server Started @2066676ms
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37006}
   [junit4]   2> 2064743 ERROR (jetty-launcher-11154-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2064743 INFO  (jetty-launcher-11154-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-02-10T16:13:37.242Z
   [junit4]   2> 2064746 INFO  (jetty-launcher-11154-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@783b224c{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:51867}
   [junit4]   2> 2064746 INFO  (jetty-launcher-11154-thread-1) [    ] o.e.j.s.Server Started @2066678ms
   [junit4]   2> 2064746 INFO  (jetty-launcher-11154-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51867}
   [junit4]   2> 2064748 ERROR (jetty-launcher-11154-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2064748 INFO  (jetty-launcher-11154-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2064749 INFO  (jetty-launcher-11154-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2064749 INFO  (jetty-launcher-11154-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2064749 INFO  (jetty-launcher-11154-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2064749 INFO  (jetty-launcher-11154-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-02-10T16:13:37.248Z
   [junit4]   2> 2064752 INFO  (zkConnectionManagerCallback-11156-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2064753 INFO  (jetty-launcher-11154-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2064753 INFO  (zkConnectionManagerCallback-11158-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2064755 INFO  (jetty-launcher-11154-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2064763 INFO  (zkConnectionManagerCallback-11160-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2064766 INFO  (jetty-launcher-11154-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2065289 INFO  (jetty-launcher-11154-thread-3) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2065291 WARN  (jetty-launcher-11154-thread-3) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@150c0965[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2065295 WARN  (jetty-launcher-11154-thread-3) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@5d767c10[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2065295 INFO  (jetty-launcher-11154-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58635/solr
   [junit4]   2> 2065320 INFO  (zkConnectionManagerCallback-11166-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2065325 INFO  (zkConnectionManagerCallback-11168-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2065422 INFO  (jetty-launcher-11154-thread-3) [n:127.0.0.1:52133_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:52133_solr
   [junit4]   2> 2065423 INFO  (jetty-launcher-11154-thread-3) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer Overseer (id=72061829724176391-127.0.0.1:52133_solr-n_0000000000) starting
   [junit4]   2> 2065433 INFO  (zkConnectionManagerCallback-11175-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2065438 INFO  (jetty-launcher-11154-thread-3) [n:127.0.0.1:52133_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58635/solr ready
   [junit4]   2> 2065440 INFO  (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:52133_solr
   [junit4]   2> 2065440 INFO  (jetty-launcher-11154-thread-3) [n:127.0.0.1:52133_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52133_solr
   [junit4]   2> 2065444 INFO  (zkCallback-11167-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2065456 INFO  (zkCallback-11174-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2065482 INFO  (jetty-launcher-11154-thread-3) [n:127.0.0.1:52133_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2065579 INFO  (jetty-launcher-11154-thread-3) [n:127.0.0.1:52133_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52133.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2065587 INFO  (jetty-launcher-11154-thread-3) [n:127.0.0.1:52133_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52133.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2065588 INFO  (jetty-launcher-11154-thread-3) [n:127.0.0.1:52133_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52133.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2065589 INFO  (jetty-launcher-11154-thread-3) [n:127.0.0.1:52133_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node2/.
   [junit4]   2> 2066663 INFO  (jetty-launcher-11154-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2066665 WARN  (jetty-launcher-11154-thread-1) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@4248b040[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2066675 WARN  (jetty-launcher-11154-thread-1) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@65acf392[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2066688 INFO  (jetty-launcher-11154-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58635/solr
   [junit4]   2> 2066692 INFO  (zkConnectionManagerCallback-11182-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2066708 INFO  (zkConnectionManagerCallback-11184-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2066717 INFO  (jetty-launcher-11154-thread-1) [n:127.0.0.1:51867_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2066721 INFO  (jetty-launcher-11154-thread-1) [n:127.0.0.1:51867_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:51867_solr as DOWN
   [junit4]   2> 2066723 INFO  (jetty-launcher-11154-thread-1) [n:127.0.0.1:51867_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2066723 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:51867_solr"} current state version: 0
   [junit4]   2> 2066723 INFO  (jetty-launcher-11154-thread-1) [n:127.0.0.1:51867_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51867_solr
   [junit4]   2> 2066738 INFO  (zkCallback-11174-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2066738 INFO  (zkCallback-11167-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2066739 INFO  (zkCallback-11183-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2066772 INFO  (zkConnectionManagerCallback-11191-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2066773 INFO  (jetty-launcher-11154-thread-1) [n:127.0.0.1:51867_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2066775 INFO  (jetty-launcher-11154-thread-1) [n:127.0.0.1:51867_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58635/solr ready
   [junit4]   2> 2066776 INFO  (jetty-launcher-11154-thread-1) [n:127.0.0.1:51867_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2066795 INFO  (jetty-launcher-11154-thread-1) [n:127.0.0.1:51867_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51867.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2066806 INFO  (jetty-launcher-11154-thread-1) [n:127.0.0.1:51867_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51867.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2066806 INFO  (jetty-launcher-11154-thread-1) [n:127.0.0.1:51867_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51867.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2066807 INFO  (jetty-launcher-11154-thread-1) [n:127.0.0.1:51867_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node1/.
   [junit4]   2> 2066892 INFO  (jetty-launcher-11154-thread-2) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2066900 WARN  (jetty-launcher-11154-thread-2) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@68a52be3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2066912 WARN  (jetty-launcher-11154-thread-2) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@248e6d3b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2066913 INFO  (jetty-launcher-11154-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58635/solr
   [junit4]   2> 2066918 INFO  (zkConnectionManagerCallback-11198-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2066947 INFO  (zkConnectionManagerCallback-11200-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2066954 INFO  (jetty-launcher-11154-thread-2) [n:127.0.0.1:37006_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2067008 INFO  (jetty-launcher-11154-thread-2) [n:127.0.0.1:37006_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:37006_solr as DOWN
   [junit4]   2> 2067010 INFO  (jetty-launcher-11154-thread-2) [n:127.0.0.1:37006_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2067010 INFO  (jetty-launcher-11154-thread-2) [n:127.0.0.1:37006_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37006_solr
   [junit4]   2> 2067011 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:37006_solr"} current state version: 0
   [junit4]   2> 2067015 INFO  (zkCallback-11167-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2067016 INFO  (zkCallback-11174-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2067016 INFO  (zkCallback-11183-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2067016 INFO  (zkCallback-11190-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2067025 INFO  (zkCallback-11199-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2067058 INFO  (zkConnectionManagerCallback-11207-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2067061 INFO  (jetty-launcher-11154-thread-2) [n:127.0.0.1:37006_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2067093 INFO  (jetty-launcher-11154-thread-2) [n:127.0.0.1:37006_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58635/solr ready
   [junit4]   2> 2067093 INFO  (jetty-launcher-11154-thread-2) [n:127.0.0.1:37006_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2067117 INFO  (jetty-launcher-11154-thread-2) [n:127.0.0.1:37006_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37006.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2067126 INFO  (jetty-launcher-11154-thread-2) [n:127.0.0.1:37006_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37006.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2067126 INFO  (jetty-launcher-11154-thread-2) [n:127.0.0.1:37006_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37006.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2067132 INFO  (jetty-launcher-11154-thread-2) [n:127.0.0.1:37006_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node3/.
   [junit4]   2> 2067188 INFO  (zkConnectionManagerCallback-11213-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2067189 INFO  (SUITE-DistributedVersionInfoTest-seed#[29D534D650B0A5CC]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2067192 INFO  (SUITE-DistributedVersionInfoTest-seed#[29D534D650B0A5CC]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58635/solr ready
   [junit4]   2> 2067279 INFO  (TEST-DistributedVersionInfoTest.testReplicaVersionHandling-seed#[29D534D650B0A5CC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testReplicaVersionHandling
   [junit4]   2> 2067295 INFO  (qtp109685290-33421) [n:127.0.0.1:37006_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&collection.configName=conf&name=c8n_vers_1x3&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2067321 INFO  (qtp109685290-33421) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&collection.configName=conf&name=c8n_vers_1x3&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=26
   [junit4]   2> 2067324 INFO  (OverseerThreadFactory-11038-thread-1-processing-n:127.0.0.1:52133_solr) [n:127.0.0.1:52133_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection c8n_vers_1x3
   [junit4]   2> 2067324 INFO  (qtp109685290-33424) [n:127.0.0.1:37006_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2067334 INFO  (qtp109685290-33424) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=9
   [junit4]   2> 2067344 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"c8n_vers_1x3",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "async":"7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 2067457 INFO  (qtp109685290-33420) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 2067460 INFO  (qtp109685290-33422) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 2067462 INFO  (qtp109685290-33425) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 2067463 INFO  (qtp109685290-33421) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2067465 INFO  (qtp109685290-33424) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2067473 INFO  (qtp1330092796-33409) [n:127.0.0.1:52133_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2067475 INFO  (qtp1330092796-33414) [n:127.0.0.1:52133_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2067476 INFO  (qtp1330092796-33416) [n:127.0.0.1:52133_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 2067478 INFO  (qtp1330092796-33410) [n:127.0.0.1:52133_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2067484 INFO  (qtp1330092796-33417) [n:127.0.0.1:52133_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=5
   [junit4]   2> 2067493 INFO  (qtp1893378544-33433) [n:127.0.0.1:51867_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2067501 INFO  (qtp1893378544-33434) [n:127.0.0.1:51867_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2067506 INFO  (qtp1893378544-33411) [n:127.0.0.1:51867_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
   [junit4]   2> 2067513 INFO  (qtp1893378544-33430) [n:127.0.0.1:51867_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2067521 INFO  (qtp1893378544-33428) [n:127.0.0.1:51867_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 2067533 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:51867/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 2067533 INFO  (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:51867/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 2067541 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:52133/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 2067541 INFO  (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:52133/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 2067550 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37006/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 2067550 INFO  (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37006/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 2067754 INFO  (qtp109685290-33426) [n:127.0.0.1:37006_solr    x:c8n_vers_1x3_shard1_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&collection=c8n_vers_1x3&version=2&replicaType=NRT&async=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653&coreNodeName=core_node6&name=c8n_vers_1x3_shard1_replica_n4&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=0
   [junit4]   2> 2067755 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr    x:c8n_vers_1x3_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&collection=c8n_vers_1x3&version=2&replicaType=NRT&async=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421&coreNodeName=core_node2&name=c8n_vers_1x3_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=1
   [junit4]   2> 2067755 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr    x:c8n_vers_1x3_shard1_replica_n4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&collection=c8n_vers_1x3&version=2&replicaType=NRT&async=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653&coreNodeName=core_node6&name=c8n_vers_1x3_shard1_replica_n4&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 2067755 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr    x:c8n_vers_1x3_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&collection=c8n_vers_1x3&version=2&replicaType=NRT&async=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421&coreNodeName=core_node2&name=c8n_vers_1x3_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 2067756 INFO  (qtp1330092796-33412) [n:127.0.0.1:52133_solr    x:c8n_vers_1x3_shard1_replica_n3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&collection=c8n_vers_1x3&version=2&replicaType=NRT&async=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490&coreNodeName=core_node5&name=c8n_vers_1x3_shard1_replica_n3&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=1
   [junit4]   2> 2067756 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr    x:c8n_vers_1x3_shard1_replica_n3] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&collection=c8n_vers_1x3&version=2&replicaType=NRT&async=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490&coreNodeName=core_node5&name=c8n_vers_1x3_shard1_replica_n3&action=CREATE&numShards=1&shard=shard1&wt=javabin
   [junit4]   2> 2067757 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr    x:c8n_vers_1x3_shard1_replica_n3] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2067779 INFO  (qtp1330092796-33416) [n:127.0.0.1:52133_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490
   [junit4]   2> 2067779 INFO  (qtp1330092796-33416) [n:127.0.0.1:52133_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2067788 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n3",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:52133/solr",
   [junit4]   2>   "node_name":"127.0.0.1:52133_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2067789 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:51867/solr",
   [junit4]   2>   "node_name":"127.0.0.1:51867_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2067789 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n4",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:37006/solr",
   [junit4]   2>   "node_name":"127.0.0.1:37006_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2068335 INFO  (qtp109685290-33420) [n:127.0.0.1:37006_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2068337 INFO  (qtp109685290-33420) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 2068827 INFO  (qtp1330092796-33410) [n:127.0.0.1:52133_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490
   [junit4]   2> 2068827 INFO  (qtp1330092796-33410) [n:127.0.0.1:52133_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2068918 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2068919 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2068932 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2068959 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.s.IndexSchema [c8n_vers_1x3_shard1_replica_n3] Schema name=minimal
   [junit4]   2> 2068960 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.s.IndexSchema [c8n_vers_1x3_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 2068963 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2068963 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'c8n_vers_1x3_shard1_replica_n3' using configuration from collection c8n_vers_1x3, trusted=true
   [junit4]   2> 2068966 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.s.IndexSchema [c8n_vers_1x3_shard1_replica_n4] Schema name=minimal
   [junit4]   2> 2068966 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52133.solr.core.c8n_vers_1x3.shard1.replica_n3' (registry 'solr.core.c8n_vers_1x3.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2068966 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.c.SolrCore [[c8n_vers_1x3_shard1_replica_n3] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node2/c8n_vers_1x3_shard1_replica_n3], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node2/./c8n_vers_1x3_shard1_replica_n3/data/]
   [junit4]   2> 2068968 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2068968 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'c8n_vers_1x3_shard1_replica_n4' using configuration from collection c8n_vers_1x3, trusted=true
   [junit4]   2> 2068969 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37006.solr.core.c8n_vers_1x3.shard1.replica_n4' (registry 'solr.core.c8n_vers_1x3.shard1.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2068969 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.SolrCore [[c8n_vers_1x3_shard1_replica_n4] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node3/c8n_vers_1x3_shard1_replica_n4], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node3/./c8n_vers_1x3_shard1_replica_n4/data/]
   [junit4]   2> 2068985 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2068988 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'c8n_vers_1x3_shard1_replica_n1' using configuration from collection c8n_vers_1x3, trusted=true
   [junit4]   2> 2068992 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51867.solr.core.c8n_vers_1x3.shard1.replica_n1' (registry 'solr.core.c8n_vers_1x3.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2068996 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.SolrCore [[c8n_vers_1x3_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node1/c8n_vers_1x3_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node1/./c8n_vers_1x3_shard1_replica_n1/data/]
   [junit4]   2> 2069076 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2069076 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2069078 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2069079 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2069080 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@683ca70e[c8n_vers_1x3_shard1_replica_n4] main]
   [junit4]   2> 2069081 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2069082 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2069082 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2069082 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1625099045784518656
   [junit4]   2> 2069087 INFO  (searcherExecutor-11058-thread-1-processing-x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 r:core_node6 CREATE n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.SolrCore [c8n_vers_1x3_shard1_replica_n4] Registered new searcher Searcher@683ca70e[c8n_vers_1x3_shard1_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2069102 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/c8n_vers_1x3/terms/shard1 to Terms{values={core_node6=0}, version=0}
   [junit4]   2> 2069102 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/c8n_vers_1x3/leaders/shard1
   [junit4]   2> 2069109 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2069109 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2069113 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"c8n_vers_1x3"} current state version: 0
   [junit4]   2> 2069113 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=3 found=1 timeoutin=9998ms
   [junit4]   2> 2069113 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2069113 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2069129 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@3c17d3f7[c8n_vers_1x3_shard1_replica_n3] main]
   [junit4]   2> 2069144 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2069158 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2069159 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2069159 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1625099045865259008
   [junit4]   2> 2069171 INFO  (searcherExecutor-11057-thread-1-processing-x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 r:core_node5 CREATE n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.c.SolrCore [c8n_vers_1x3_shard1_replica_n3] Registered new searcher Searcher@3c17d3f7[c8n_vers_1x3_shard1_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2069178 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2069178 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2069184 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2069184 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2069185 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@492fe12b[c8n_vers_1x3_shard1_replica_n1] main]
   [junit4]   2> 2069197 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.c.ZkShardTerms Successful update of terms at /collections/c8n_vers_1x3/terms/shard1 to Terms{values={core_node6=0, core_node5=0}, version=1}
   [junit4]   2> 2069197 INFO  (parallelCoreAdminExecutor-11039-thread-1-processing-n:127.0.0.1:52133_solr x:c8n_vers_1x3_shard1_replica_n3 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490 CREATE) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/c8n_vers_1x3/leaders/shard1
   [junit4]   2> 2069197 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2069200 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2069202 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2069202 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1625099045910347776
   [junit4]   2> 2069212 INFO  (searcherExecutor-11059-thread-1-processing-x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 r:core_node2 CREATE n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.SolrCore [c8n_vers_1x3_shard1_replica_n1] Registered new searcher Searcher@492fe12b[c8n_vers_1x3_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2069228 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/c8n_vers_1x3/terms/shard1 to Terms{values={core_node6=0, core_node2=0, core_node5=0}, version=2}
   [junit4]   2> 2069228 INFO  (parallelCoreAdminExecutor-11046-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421 CREATE) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/c8n_vers_1x3/leaders/shard1
   [junit4]   2> 2069338 INFO  (qtp109685290-33422) [n:127.0.0.1:37006_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2069340 INFO  (qtp109685290-33422) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 2069633 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2069633 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2069633 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37006/solr/c8n_vers_1x3_shard1_replica_n4/
   [junit4]   2> 2069634 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.u.PeerSync PeerSync: core=c8n_vers_1x3_shard1_replica_n4 url=http://127.0.0.1:37006/solr START replicas=[http://127.0.0.1:51867/solr/c8n_vers_1x3_shard1_replica_n1/, http://127.0.0.1:52133/solr/c8n_vers_1x3_shard1_replica_n3/] nUpdates=100
   [junit4]   2> 2069636 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.u.PeerSync PeerSync: core=c8n_vers_1x3_shard1_replica_n4 url=http://127.0.0.1:37006/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 2069638 INFO  (qtp1893378544-33434) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.S.Request [c8n_vers_1x3_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 2069640 INFO  (qtp1330092796-33412) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.c.S.Request [c8n_vers_1x3_shard1_replica_n3]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2069640 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 2069640 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 2069640 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/c8n_vers_1x3/leaders/shard1/leader after winning as /collections/c8n_vers_1x3/leader_elect/shard1/election/72061829724176397-core_node6-n_0000000000
   [junit4]   2> 2069643 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37006/solr/c8n_vers_1x3_shard1_replica_n4/ shard1
   [junit4]   2> 2069646 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "base_url":"http://127.0.0.1:37006/solr",
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n4",
   [junit4]   2>   "state":"active"} current state version: 0
   [junit4]   2> 2069748 INFO  (zkCallback-11199-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_vers_1x3/state.json] for collection [c8n_vers_1x3] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2069773 INFO  (parallelCoreAdminExecutor-11053-thread-1-processing-n:127.0.0.1:37006_solr x:c8n_vers_1x3_shard1_replica_n4 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653 CREATE) [n:127.0.0.1:37006_solr c:c8n_vers_1x3 s:shard1 r:core_node6 x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2069776 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n4",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:37006/solr",
   [junit4]   2>   "node_name":"127.0.0.1:37006_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2069845 INFO  (qtp1330092796-33409) [n:127.0.0.1:52133_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490
   [junit4]   2> 2069845 INFO  (qtp1330092796-33409) [n:127.0.0.1:52133_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2069878 INFO  (zkCallback-11199-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_vers_1x3/state.json] for collection [c8n_vers_1x3] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2069878 INFO  (zkCallback-11199-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_vers_1x3/state.json] for collection [c8n_vers_1x3] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2070221 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n3",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:52133/solr",
   [junit4]   2>   "node_name":"127.0.0.1:52133_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2070248 DEBUG (OverseerStateUpdate-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"c8n_vers_1x3_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node2",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:51867/solr",
   [junit4]   2>   "node_name":"127.0.0.1:51867_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"c8n_vers_1x3",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2070343 INFO  (qtp109685290-33425) [n:127.0.0.1:37006_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2070345 INFO  (qtp109685290-33425) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 2070349 INFO  (zkCallback-11199-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_vers_1x3/state.json] for collection [c8n_vers_1x3] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2070349 INFO  (zkCallback-11199-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_vers_1x3/state.json] for collection [c8n_vers_1x3] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2070349 INFO  (zkCallback-11167-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_vers_1x3/state.json] for collection [c8n_vers_1x3] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2070350 INFO  (zkCallback-11167-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_vers_1x3/state.json] for collection [c8n_vers_1x3] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2070350 INFO  (zkCallback-11183-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_vers_1x3/state.json] for collection [c8n_vers_1x3] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2070350 INFO  (zkCallback-11183-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_vers_1x3/state.json] for collection [c8n_vers_1x3] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2070853 INFO  (qtp1330092796-33414) [n:127.0.0.1:52133_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490
   [junit4]   2> 2070853 INFO  (qtp1330092796-33414) [n:127.0.0.1:52133_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634377429490&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2070856 INFO  (qtp1893378544-33428) [n:127.0.0.1:51867_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421
   [junit4]   2> 2070856 INFO  (qtp1893378544-33428) [n:127.0.0.1:51867_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634369768421&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2070860 INFO  (qtp109685290-33426) [n:127.0.0.1:37006_solr    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653
   [junit4]   2> 2070860 INFO  (qtp109685290-33426) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea4264634386739653&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2070878 INFO  (OverseerThreadFactory-11038-thread-1-processing-n:127.0.0.1:52133_solr) [n:127.0.0.1:52133_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2071330 INFO  (OverseerCollectionConfigSetProcessor-72061829724176391-127.0.0.1:52133_solr-n_0000000000) [n:127.0.0.1:52133_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2071358 INFO  (qtp109685290-33420) [n:127.0.0.1:37006_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2071366 INFO  (qtp109685290-33420) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=7
   [junit4]   2> 2071367 INFO  (qtp109685290-33422) [n:127.0.0.1:37006_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2071368 INFO  (qtp109685290-33422) [n:127.0.0.1:37006_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=7ce328bf-2b0c-4ed1-96e9-610f5dd1ea42&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 2071374 INFO  (qtp109685290-33421) [n:127.0.0.1:37006_solr    x:c8n_vers_1x3_shard1_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={core=c8n_vers_1x3_shard1_replica_n4&action=STATUS&indexInfo=true&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2072378 INFO  (TEST-DistributedVersionInfoTest.testReplicaVersionHandling-seed#[29D534D650B0A5CC]) [    ] o.a.s.c.DistributedVersionInfoTest Sending RELOAD command for c8n_vers_1x3
   [junit4]   2> 2072382 INFO  (qtp109685290-33424) [n:127.0.0.1:37006_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :reload with params name=c8n_vers_1x3&action=RELOAD&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2072386 INFO  (OverseerThreadFactory-11038-thread-2-processing-n:127.0.0.1:52133_solr) [n:127.0.0.1:52133_solr    ] o.a.s.c.a.c.OverseerCollectionMessageHandler Executing Collection Cmd=action=RELOAD, asyncId=null
   [junit4]   2> 2072409 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr    x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2072477 INFO  (qtp1330092796-33416) [n:127.0.0.1:52133_solr    x:c8n_vers_1x3_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2072477 INFO  (qtp109685290-33426) [n:127.0.0.1:37006_solr    x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2072487 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr    x:c8n_vers_1x3_shard1_replica_n1] o.a.s.s.IndexSchema [c8n_vers_1x3_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 2072488 INFO  (qtp1330092796-33416) [n:127.0.0.1:52133_solr    x:c8n_vers_1x3_shard1_replica_n3] o.a.s.s.IndexSchema [c8n_vers_1x3_shard1_replica_n3] Schema name=minimal
   [junit4]   2> 2072490 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr    x:c8n_vers_1x3_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2072491 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr    x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.CoreContainer Reloading SolrCore 'c8n_vers_1x3_shard1_replica_n1' using configuration from collection c8n_vers_1x3
   [junit4]   2> 2072491 INFO  (qtp1330092796-33416) [n:127.0.0.1:52133_solr    x:c8n_vers_1x3_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2072491 INFO  (qtp1330092796-33416) [n:127.0.0.1:52133_solr    x:c8n_vers_1x3_shard1_replica_n3] o.a.s.c.CoreContainer Reloading SolrCore 'c8n_vers_1x3_shard1_replica_n3' using configuration from collection c8n_vers_1x3
   [junit4]   2> 2072510 INFO  (qtp109685290-33426) [n:127.0.0.1:37006_solr    x:c8n_vers_1x3_shard1_replica_n4] o.a.s.s.IndexSchema [c8n_vers_1x3_shard1_replica_n4] Schema name=minimal
   [junit4]   2> 2072520 INFO  (qtp109685290-33426) [n:127.0.0.1:37006_solr    x:c8n_vers_1x3_shard1_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2072520 INFO  (qtp109685290-33426) [n:127.0.0.1:37006_solr    x:c8n_vers_1x3_shard1_replica_n4] o.a.s.c.CoreContainer Reloading SolrCore 'c8n_vers_1x3_shard1_replica_n4' using configuration from collection c8n_vers_1x3
   [junit4]   2> 2072707 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51867.solr.core.c8n_vers_1x3.shard1.replica_n1' (registry 'solr.core.c8n_vers_1x3.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2072707 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.SolrCore [[c8n_vers_1x3_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node1/c8n_vers_1x3_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node1/./c8n_vers_1x3_shard1_replica_n1/data/]
   [junit4]   2> 2072821 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2072821 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2072840 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@20431993[c8n_vers_1x3_shard1_replica_n1] main]
   [junit4]   2> 2072844 INFO  (qtp1330092796-33416) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52133.solr.core.c8n_vers_1x3.shard1.replica_n3' (registry 'solr.core.c8n_vers_1x3.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@58c9a893
   [junit4]   2> 2072844 INFO  (qtp1330092796-33416) [n:127.0.0.1:52133_solr c:c8n_vers_1x3 s:shard1 r:core_node5 x:c8n_vers_1x3_shard1_replica_n3] o.a.s.c.SolrCore [[c8n_vers_1x3_shard1_replica_n3] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node2/c8n_vers_1x3_shard1_replica_n3], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.DistributedVersionInfoTest_29D534D650B0A5CC-001/tempDir-001/node2/./c8n_vers_1x3_shard1_replica_n3/data/]
   [junit4]   2> 2072847 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2072848 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2072848 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2072848 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1625099049733455872
   [junit4]   2> 2072851 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 2072853 INFO  (searcherExecutor-11072-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 c:c8n_vers_1x3 s:shard1 r:core_node2) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.SolrCore [c8n_vers_1x3_shard1_replica_n1] Registered new searcher Searcher@20431993[c8n_vers_1x3_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2072854 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@789c5269[c8n_vers_1x3_shard1_replica_n1] main]
   [junit4]   2> 2072854 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.SolrCore [c8n_vers_1x3_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4adffd4c
   [junit4]   2> 2072854 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.c8n_vers_1x3.shard1.replica_n1, tag=4adffd4c
   [junit4]   2> 2072854 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4f45bf1e: rootName = solr_51867, domain = solr.core.c8n_vers_1x3.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.c8n_vers_1x3.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@7ccdf931
   [junit4]   2> 2072861 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.c8n_vers_1x3.shard1.leader, tag=4adffd4c
   [junit4]   2> 2072863 INFO  (searcherExecutor-11072-thread-1-processing-n:127.0.0.1:51867_solr x:c8n_vers_1x3_shard1_replica_n1 c:c8n_vers_1x3 s:shard1 r:core_node2) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.c.SolrCore [c8n_vers_1x3_shard1_replica_n1] Registered new searcher Searcher@789c5269[c8n_vers_1x3_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2072863 INFO  (qtp1893378544-33432) [n:127.0.0.1:51867_solr c:c8n_vers_1x3 s:shard1 r:core_node2 x:c8n_vers_1x3_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={core=c8n_vers_1x3_shard1_replica_n1&

[...truncated too long message...]

int:unchecked for details.
    [javac] Creating empty /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/classes/test/org/apache/solr/cloud/autoscaling/sim/package-info.class
     [copy] Copying 1 file to /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/classes/test

common-solr.compile-test:

compile-test:

BUILD SUCCESSFUL
Total time: 56 seconds
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.DistributedVersionInfoTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseConcMarkSweepGC" -Dtests.seed=29D534D650B0A5CC -Dtests.slow=true -Dtests.locale=es-ES -Dtests.timezone=Pacific/Truk -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
Buildfile: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/build.xml

-clover.disable:

ivy-configure:
[ivy:configure] :: Apache Ivy 2.4.0 - 20141213170938 :: http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file = /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/lucene/top-level-ivy-settings.xml

install-junit4-taskdef:

ivy-availability-check:
[loadresource] Do not set property disallowed.ivy.jars.list as its length is 0.

-ivy-fail-disallowed-ivy-version:

ivy-fail:

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] confs: [default]
[ivy:cachepath] found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 14ms :: artifacts dl 0ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
        ---------------------------------------------------------------------

-init-totals:

-test:
    [mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: 29D534D650B0A5CC
    [mkdir] Created dir: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/temp
   [junit4] <JUnit4> says ahoj! Master seed: 29D534D650B0A5CC
   [junit4] Executing 5 suites with 2 JVMs.
   [junit4]
   [junit4] Started J0 PID(11618@serv1-vm3).
   [junit4] Started J1 PID(11617@serv1-vm3).
   [junit4] Suite: org.apache.solr.cloud.DistributedVersionInfoTest
   [junit4] OK      35.3s J1 | DistributedVersionInfoTest.testReplicaVersionHandling
   [junit4] Completed [1/5] on J1 in 44.55s, 1 test
   [junit4]
   [junit4] Suite: org.apache.solr.cloud.DistributedVersionInfoTest
   [junit4] OK      34.8s J0 | DistributedVersionInfoTest.testReplicaVersionHandling
   [junit4] Completed [2/5] on J0 in 44.66s, 1 test
   [junit4]
   [junit4] Suite: org.apache.solr.cloud.DistributedVersionInfoTest
   [junit4] OK      36.4s J0 | DistributedVersionInfoTest.testReplicaVersionHandling
   [junit4] Completed [3/5] on J0 in 41.93s, 1 test
   [junit4]
   [junit4] Suite: org.apache.solr.cloud.DistributedVersionInfoTest
   [junit4] OK      37.3s J1 | DistributedVersionInfoTest.testReplicaVersionHandling
   [junit4] Completed [4/5] on J1 in 42.07s, 1 test
   [junit4]
   [junit4] Suite: org.apache.solr.cloud.DistributedVersionInfoTest
   [junit4] OK      36.5s J0 | DistributedVersionInfoTest.testReplicaVersionHandling
   [junit4] Completed [5/5] on J0 in 40.60s, 1 test
   [junit4]
   [junit4] JVM J0:     0.70 ..   129.09 =   128.39s
   [junit4] JVM J1:     0.70 ..    89.05 =    88.35s
   [junit4] Execution time total: 2 minutes 9 seconds
   [junit4] Tests summary: 5 suites, 5 tests
   [junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp])
   [junit4] Could not remove temporary path: /export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp])
     [echo] 5 slowest tests:
[junit4:tophints] 10809.79s | org.apache.solr.cloud.DistributedVersionInfoTest
[junit4:tophints] 200.98s | org.apache.solr.search.facet.TestJsonFacets
[junit4:tophints] 160.60s | org.apache.solr.cloud.api.collections.ShardSplitTest
[junit4:tophints] 119.02s | org.apache.solr.cloud.CollectionsAPISolrJTest
[junit4:tophints] 117.02s | org.apache.solr.update.SoftAutoCommitTest

-check-totals:

test-nocompile:

BUILD SUCCESSFUL
Total time: 2 minutes 12 seconds
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.DistributedVersionInfoTest
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2801)
        at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2680)
        at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2661)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3040)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to Solaris VBOX
                at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1743)
                at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:957)
                at hudson.FilePath.act(FilePath.java:1067)
                at hudson.FilePath.act(FilePath.java:1056)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2659)
                at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1841)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3042)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath.act(FilePath.java:1069)
        at hudson.FilePath.act(FilePath.java:1056)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2659)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1841)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
No credentials specified
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=b63b8756b7e96b981bc4152f9b20ad74dad6846c, workspace=/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #35
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]