Quantcast

[JENKINS] Lucene-Solr-6.x-MacOSX (64bit/jdk1.8.0) - Build # 824 - Unstable!

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[JENKINS] Lucene-Solr-6.x-MacOSX (64bit/jdk1.8.0) - Build # 824 - Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/824/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC

7 tests failed.
FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test

Error Message:
Could not find collection:collection2

Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
        at __randomizedtesting.SeedInfo.seed([445D3C0CCB7987B6:CC0903D66585EA4E]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:159)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:144)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:139)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:856)
        at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:620)
        at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestTolerantUpdateProcessorCloud

Error Message:
java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO

Stack Trace:
org.apache.solr.common.SolrException: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO
        at __randomizedtesting.SeedInfo.seed([445D3C0CCB7987B6]:0)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:170)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:116)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:111)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:98)
        at org.apache.solr.cloud.MiniSolrCloudCluster.waitForAllNodes(MiniSolrCloudCluster.java:270)
        at org.apache.solr.cloud.MiniSolrCloudCluster.<init>(MiniSolrCloudCluster.java:264)
        at org.apache.solr.cloud.SolrCloudTestCase$Builder.configure(SolrCloudTestCase.java:188)
        at org.apache.solr.cloud.TestTolerantUpdateProcessorCloud.createMiniSolrCloudCluster(TestTolerantUpdateProcessorCloud.java:110)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:847)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO
        at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1782)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:447)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380)
        at org.apache.solr.common.cloud.SolrZooKeeper.<init>(SolrZooKeeper.java:43)
        at org.apache.solr.common.cloud.ZkClientConnectionStrategy.createSolrZooKeeper(ZkClientConnectionStrategy.java:105)
        at org.apache.solr.common.cloud.DefaultConnectionStrategy.connect(DefaultConnectionStrategy.java:37)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:145)
        ... 31 more
Caused by: java.io.IOException: Too many open files
        at sun.nio.ch.IOUtil.makePipe(Native Method)
        at sun.nio.ch.KQueueSelectorImpl.<init>(KQueueSelectorImpl.java:84)
        at sun.nio.ch.KQueueSelectorProvider.openSelector(KQueueSelectorProvider.java:42)
        at java.nio.channels.Selector.open(Selector.java:227)
        at org.apache.zookeeper.ClientCnxnSocketNIO.<init>(ClientCnxnSocketNIO.java:43)
        at sun.reflect.GeneratedConstructorAccessor249.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at java.lang.Class.newInstance(Class.java:442)
        at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1779)
        ... 37 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestTolerantUpdateProcessorCloud

Error Message:
ObjectTracker found 11 object(s) that were not released!!! [SolrZkClient, ZkController, ZkController, SolrZkClient, Overseer, SolrZkClient, ZkController, ZkController, ZkController, SolrZkClient, SolrZkClient] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)  at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)  at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)  at java.lang.Thread.run(Thread.java:745)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)  at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)  at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)  at java.lang.Thread.run(Thread.java:745)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)  at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)  at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)  at java.lang.Thread.run(Thread.java:745)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)  at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)  at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)  at java.lang.Thread.run(Thread.java:745)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.Overseer  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.cloud.Overseer.start(Overseer.java:525)  at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:754)  at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)  at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)  at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307)  at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:216)  at org.apache.solr.cloud.ZkController.init(ZkController.java:688)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:423)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)  at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)  at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)  at java.lang.Thread.run(Thread.java:745)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)  at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)  at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)  at java.lang.Thread.run(Thread.java:745)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)  at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)  at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)  at java.lang.Thread.run(Thread.java:745)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)  at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)  at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)  at java.lang.Thread.run(Thread.java:745)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)  at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)  at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)  at java.lang.Thread.run(Thread.java:745)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)  at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)  at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)  at java.lang.Thread.run(Thread.java:745)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)  at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)  at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)  at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)  at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)  at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)  at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)  at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)  at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)  at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)  at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)  at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)  at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)  at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)  at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)  at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)  at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)  at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)  at java.util.concurrent.FutureTask.run(FutureTask.java:266)  at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)  at java.lang.Thread.run(Thread.java:745)  

Stack Trace:
java.lang.AssertionError: ObjectTracker found 11 object(s) that were not released!!! [SolrZkClient, ZkController, ZkController, SolrZkClient, Overseer, SolrZkClient, ZkController, ZkController, ZkController, SolrZkClient, SolrZkClient]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient
        at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)
        at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)
        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)
        at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController
        at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)
        at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)
        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)
        at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController
        at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)
        at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)
        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)
        at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient
        at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)
        at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)
        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)
        at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.Overseer
        at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.cloud.Overseer.start(Overseer.java:525)
        at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:754)
        at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
        at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
        at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307)
        at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:216)
        at org.apache.solr.cloud.ZkController.init(ZkController.java:688)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:423)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)
        at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)
        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)
        at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient
        at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)
        at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)
        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)
        at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController
        at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)
        at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)
        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)
        at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController
        at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)
        at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)
        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)
        at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController
        at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:425)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)
        at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)
        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)
        at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient
        at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)
        at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)
        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)
        at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient
        at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:184)
        at org.apache.solr.cloud.ZkController.<init>(ZkController.java:299)
        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:478)
        at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:234)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:167)
        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
        at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
        at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
        at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
        at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
        at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:386)
        at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:249)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)


        at __randomizedtesting.SeedInfo.seed([445D3C0CCB7987B6]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:302)
        at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestTolerantUpdateProcessorCloud

Error Message:
Could not remove the following files (in the order of attempts):    /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001/tempDir-001: java.nio.file.FileSystemException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001/tempDir-001: Too many open files    /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001/init-core-data-001: java.nio.file.FileSystemException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001/init-core-data-001: Too many open files    /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001: java.nio.file.FileSystemException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001: Too many open files

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001/tempDir-001: java.nio.file.FileSystemException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001/tempDir-001: Too many open files
   /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001/init-core-data-001: java.nio.file.FileSystemException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001/init-core-data-001: Too many open files
   /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001: java.nio.file.FileSystemException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_445D3C0CCB7987B6-001: Too many open files

        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:323)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestTolerantUpdateProcessorCloud

Error Message:
87 threads leaked from SUITE scope at org.apache.solr.cloud.TestTolerantUpdateProcessorCloud:     1) Thread[id=21685, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at java.lang.Object.wait(Native Method)         at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146)    2) Thread[id=21700, name=qtp1794173443-21700, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.lang.Thread.run(Thread.java:745)    3) Thread[id=21736, name=qtp1732909344-21736, state=RUNNABLE, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)         at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.lang.Thread.run(Thread.java:745)    4) Thread[id=21719, name=qtp103336037-21719-acceptor-0@497cc5a5-ServerConnector@315f6f{HTTP/1.1,[http/1.1]}{127.0.0.1:51158}, state=RUNNABLE, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)         at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:373)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.lang.Thread.run(Thread.java:745)    5) Thread[id=21801, name=OverseerStateUpdate-97823805438230537-127.0.0.1:51157_solr-n_0000000000, state=TIMED_WAITING, group=Overseer state updater.]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:163)         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:137)         at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:182)         at java.lang.Thread.run(Thread.java:745)    6) Thread[id=21778, name=jetty-launcher-4089-thread-2-SendThread(127.0.0.1:51153), state=RUNNABLE, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)    7) Thread[id=21765, name=solr-idle-connections-evictor, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:266)         at java.lang.Thread.run(Thread.java:745)    8) Thread[id=21701, name=qtp1794173443-21701, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.lang.Thread.run(Thread.java:745)    9) Thread[id=21713, name=qtp75488392-21713, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.lang.Thread.run(Thread.java:745)   10) Thread[id=21717, name=org.eclipse.jetty.server.session.HashSessionManager@25530799Timer, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)   11) Thread[id=21779, name=jetty-launcher-4089-thread-2-EventThread, state=WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)   12) Thread[id=21796, name=jetty-launcher-4089-thread-3-EventThread, state=WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)   13) Thread[id=21727, name=org.eclipse.jetty.server.session.HashSessionManager@6aa24ff3Timer, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)   14) Thread[id=21704, name=Scheduler-1122649076, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)   15) Thread[id=21687, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120)   16) Thread[id=21747, name=org.eclipse.jetty.server.session.HashSessionManager@639dd609Timer, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)   17) Thread[id=21772, name=solr-idle-connections-evictor, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:266)         at java.lang.Thread.run(Thread.java:745)   18) Thread[id=21735, name=qtp1046482876-21735, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.lang.Thread.run(Thread.java:745)   19) Thread[id=21791, name=zkCallback-4113-thread-1, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)   20) Thread[id=21792, name=jetty-launcher-4089-thread-1-SendThread(127.0.0.1:51153), state=RUNNABLE, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)   21) Thread[id=21697, name=qtp1794173443-21697-acceptor-0@447ca54c-ServerConnector@515e90ce{HTTP/1.1,[http/1.1]}{127.0.0.1:51155}, state=RUNNABLE, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)         at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:373)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.lang.Thread.run(Thread.java:745)   22) Thread[id=21684, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178)         at java.lang.Thread.run(Thread.java:745)   23) Thread[id=21694, name=jetty-launcher-4089-thread-4, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)   24) Thread[id=21740, name=qtp1732909344-21740, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.lang.Thread.run(Thread.java:745)   25) Thread[id=21744, name=qtp1732909344-21744, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.lang.Thread.run(Thread.java:745)   26) Thread[id=21709, name=qtp75488392-21709-acceptor-0@919b697-ServerConnector@49162542{HTTP/1.1,[http/1.1]}{127.0.0.1:51157}, state=RUNNABLE, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)         at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)         at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:373)         at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.lang.Thread.run(Thread.java:745)   27) Thread[id=21710, name=qtp75488392-21710, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.lang.Thread.run(Thread.java:745)   28) Thread[id=21777, name=solr-idle-connections-evictor, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:266)         at java.lang.Thread.run(Thread.java:745)   29) Thread[id=21799, name=jetty-launcher-4089-thread-5-EventThread, state=WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)   30) Thread[id=21762, name=solr-idle-connections-evictor, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.update.UpdateShardHandler$IdleConnectionsEvictor$1.run(UpdateShardHandler.java:266)         at java.lang.Thread.run(Thread.java:745)   31) Thread[id=21715, name=qtp75488392-21715, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access

[...truncated too long message...]

lang.Thread.run(Thread.java:745)
   [junit4]    >   23) Thread[id=21726, name=Scheduler-1079638781, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   [junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
   [junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >   24) Thread[id=21692, name=jetty-launcher-4089-thread-2, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >   25) Thread[id=21728, name=qtp1046482876-21728, state=RUNNABLE, group=TGRP-TestTolerantUpdateProcessorCloud]
   [junit4]    >         at sun.nio.ch.IOUtil.drain(Native Method)
   [junit4]    >         at sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:181)
   [junit4]    >         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:122)
   [junit4]    >         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
   [junit4]    >         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
   [junit4]    >         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
   [junit4]    >         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
   [junit4]    >         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]    >         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
   [junit4]    >         at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >   26) Thread[id=21794, name=zkCallback-4114-thread-1, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >   27) Thread[id=21800, name=zkCallback-4116-thread-1, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >   28) Thread[id=21708, name=qtp75488392-21708, state=RUNNABLE, group=TGRP-TestTolerantUpdateProcessorCloud]
   [junit4]    >         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
   [junit4]    >         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
   [junit4]    >         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)
   [junit4]    >         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
   [junit4]    >         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
   [junit4]    >         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
   [junit4]    >         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
   [junit4]    >         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]    >         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
   [junit4]    >         at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >   29) Thread[id=21745, name=Scheduler-704524474, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   [junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
   [junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >   30) Thread[id=21750, name=org.eclipse.jetty.server.session.HashSessionManager@1db1193bTimer, state=TIMED_WAITING, group=TGRP-TestTolerantUpdateProcessorCloud]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   [junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
   [junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > at __randomizedtesting.SeedInfo.seed([445D3C0CCB7987B6]:0)
   [junit4] Completed [536/704 (3!)] on J1 in 46.36s, 0 tests, 1 failure, 4 errors <<< FAILURES!

[...truncated 43952 lines...]



---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[JENKINS] Lucene-Solr-6.x-MacOSX (64bit/jdk1.8.0) - Build # 825 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/825/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC

4 tests failed.
FAILED:  org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForImplicitRouter

Error Message:
Collection not found: withShardField

Stack Trace:
org.apache.solr.common.SolrException: Collection not found: withShardField
        at __randomizedtesting.SeedInfo.seed([59432FEA2A186957:C13C77886E1A6A7]:0)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.getCollectionNames(CloudSolrClient.java:1401)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1094)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1073)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160)
        at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
        at org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForImplicitRouter(CustomCollectionTest.java:141)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI

Error Message:
Could not find collection : implicitcoll

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : implicitcoll
        at __randomizedtesting.SeedInfo.seed([59432FEA2A186957:33A2A1811782DF2F]:0)
        at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
        at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:245)
        at org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI(CustomCollectionTest.java:68)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.test

Error Message:
Task 3001 did not complete, final state: FAILED expected same:<COMPLETED> was not:<FAILED>

Stack Trace:
java.lang.AssertionError: Task 3001 did not complete, final state: FAILED expected same:<COMPLETED> was not:<FAILED>
        at __randomizedtesting.SeedInfo.seed([59432FEA2A186957:D117103084E404AF]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotSame(Assert.java:641)
        at org.junit.Assert.assertSame(Assert.java:580)
        at org.apache.solr.cloud.MultiThreadedOCPTest.testDeduplicationOfSubmittedTasks(MultiThreadedOCPTest.java:250)
        at org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:64)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.update.AutoCommitTest.testMaxDocs

Error Message:


Stack Trace:
java.lang.AssertionError
        at __randomizedtesting.SeedInfo.seed([59432FEA2A186957:E0C2F93506F26DDD]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at org.apache.solr.update.AutoCommitTest.testMaxDocs(AutoCommitTest.java:218)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12055 lines...]
   [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/init-core-data-001
   [junit4]   2> 1748644 WARN  (SUITE-MultiThreadedOCPTest-seed#[59432FEA2A186957]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
   [junit4]   2> 1748645 INFO  (SUITE-MultiThreadedOCPTest-seed#[59432FEA2A186957]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields
   [junit4]   2> 1748650 INFO  (SUITE-MultiThreadedOCPTest-seed#[59432FEA2A186957]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 1748650 INFO  (SUITE-MultiThreadedOCPTest-seed#[59432FEA2A186957]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1748652 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1748652 INFO  (Thread-2737) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1748652 INFO  (Thread-2737) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1748760 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.ZkTestServer start zk server on port:55479
   [junit4]   2> 1748814 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1748818 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1748822 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1748825 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1748828 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1748831 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1748834 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1748837 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1748841 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1748844 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1748847 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1749199 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/control-001/cores/collection1
   [junit4]   2> 1749203 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1749205 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5cf8a70c{/,null,AVAILABLE}
   [junit4]   2> 1749206 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4fd61a33{HTTP/1.1,[http/1.1]}{127.0.0.1:55482}
   [junit4]   2> 1749206 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.Server Started @1754854ms
   [junit4]   2> 1749206 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/tempDir-001/control/data, hostContext=/, hostPort=55482, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/control-001/cores}
   [junit4]   2> 1749206 ERROR (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1749207 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.6.0
   [junit4]   2> 1749207 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1749207 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1749207 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-04-20T17:41:25.668Z
   [junit4]   2> 1749212 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1749212 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/control-001/solr.xml
   [junit4]   2> 1749225 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1749226 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55479/solr
   [junit4]   2> 1749274 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55482_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1749276 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55482_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55482_
   [junit4]   2> 1749278 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55482_    ] o.a.s.c.Overseer Overseer (id=97826248138162180-127.0.0.1:55482_-n_0000000000) starting
   [junit4]   2> 1749297 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55482_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55482_
   [junit4]   2> 1749300 INFO  (zkCallback-3735-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1749405 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55482_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/control-001/cores
   [junit4]   2> 1749406 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55482_    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 1749407 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1749410 INFO  (OverseerStateUpdate-97826248138162180-127.0.0.1:55482_-n_0000000000) [n:127.0.0.1:55482_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1750440 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 1750455 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1750574 WARN  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 1750577 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1750602 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 1750603 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1750603 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/control-001/cores/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/control-001/cores/collection1/data/]
   [junit4]   2> 1750603 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@122e5a6a
   [junit4]   2> 1750605 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=6, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.475817991854974]
   [junit4]   2> 1750612 WARN  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1750709 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1750709 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1750711 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1750711 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1750711 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1392177503, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1750712 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4a84ca19[collection1] main]
   [junit4]   2> 1750715 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1750715 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1750715 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1750717 INFO  (searcherExecutor-6095-thread-1-processing-n:127.0.0.1:55482_ x:collection1 c:control_collection) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4a84ca19[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1750718 INFO  (coreLoadExecutor-6094-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_ c:control_collection   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1565219972373807104
   [junit4]   2> 1750731 INFO  (coreZkRegister-6087-thread-1-processing-n:127.0.0.1:55482_ x:collection1 c:control_collection) [n:127.0.0.1:55482_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1750731 INFO  (coreZkRegister-6087-thread-1-processing-n:127.0.0.1:55482_ x:collection1 c:control_collection) [n:127.0.0.1:55482_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1750731 INFO  (coreZkRegister-6087-thread-1-processing-n:127.0.0.1:55482_ x:collection1 c:control_collection) [n:127.0.0.1:55482_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55482/collection1/
   [junit4]   2> 1750731 INFO  (coreZkRegister-6087-thread-1-processing-n:127.0.0.1:55482_ x:collection1 c:control_collection) [n:127.0.0.1:55482_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1750731 INFO  (coreZkRegister-6087-thread-1-processing-n:127.0.0.1:55482_ x:collection1 c:control_collection) [n:127.0.0.1:55482_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:55482/collection1/ has no replicas
   [junit4]   2> 1750731 INFO  (coreZkRegister-6087-thread-1-processing-n:127.0.0.1:55482_ x:collection1 c:control_collection) [n:127.0.0.1:55482_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1750739 INFO  (coreZkRegister-6087-thread-1-processing-n:127.0.0.1:55482_ x:collection1 c:control_collection) [n:127.0.0.1:55482_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55482/collection1/ shard1
   [junit4]   2> 1750895 INFO  (coreZkRegister-6087-thread-1-processing-n:127.0.0.1:55482_ x:collection1 c:control_collection) [n:127.0.0.1:55482_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1750923 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1750925 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55479/solr ready
   [junit4]   2> 1750925 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1750925 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 1751281 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-1-001/cores/collection1
   [junit4]   2> 1751283 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-1-001
   [junit4]   2> 1751284 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1751286 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@39fcf2b2{/,null,AVAILABLE}
   [junit4]   2> 1751286 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1e51da3{HTTP/1.1,[http/1.1]}{127.0.0.1:55488}
   [junit4]   2> 1751286 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.Server Started @1756934ms
   [junit4]   2> 1751286 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=55488, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-1-001/cores}
   [junit4]   2> 1751287 ERROR (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1751287 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.6.0
   [junit4]   2> 1751287 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1751287 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1751287 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-04-20T17:41:27.748Z
   [junit4]   2> 1751292 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1751292 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-1-001/solr.xml
   [junit4]   2> 1751321 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1751322 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55479/solr
   [junit4]   2> 1751344 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1751351 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55488_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1751356 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55488_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55488_
   [junit4]   2> 1751359 INFO  (zkCallback-3735-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1751361 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1751359 INFO  (zkCallback-3739-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1751463 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55488_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-1-001/cores
   [junit4]   2> 1751463 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55488_    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 1751465 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1751470 INFO  (OverseerStateUpdate-97826248138162180-127.0.0.1:55482_-n_0000000000) [n:127.0.0.1:55482_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 1751582 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1752503 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 1752518 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1752654 WARN  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 1752658 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1752688 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1, trusted=true
   [junit4]   2> 1752688 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1752688 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-1-001/cores/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-1-001/cores/collection1/data/]
   [junit4]   2> 1752689 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@122e5a6a
   [junit4]   2> 1752689 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=6, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.475817991854974]
   [junit4]   2> 1752696 WARN  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1752799 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1752799 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1752803 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1752803 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1752809 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1392177503, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1752809 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6f51daf8[collection1] main]
   [junit4]   2> 1752811 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1752812 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1752812 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1752814 INFO  (searcherExecutor-6106-thread-1-processing-n:127.0.0.1:55488_ x:collection1 c:collection1) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6f51daf8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1752816 INFO  (coreLoadExecutor-6105-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_ c:collection1   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1565219974573719552
   [junit4]   2> 1752829 INFO  (coreZkRegister-6100-thread-1-processing-n:127.0.0.1:55488_ x:collection1 c:collection1) [n:127.0.0.1:55488_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1752829 INFO  (coreZkRegister-6100-thread-1-processing-n:127.0.0.1:55488_ x:collection1 c:collection1) [n:127.0.0.1:55488_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1752829 INFO  (coreZkRegister-6100-thread-1-processing-n:127.0.0.1:55488_ x:collection1 c:collection1) [n:127.0.0.1:55488_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55488/collection1/
   [junit4]   2> 1752829 INFO  (coreZkRegister-6100-thread-1-processing-n:127.0.0.1:55488_ x:collection1 c:collection1) [n:127.0.0.1:55488_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1752829 INFO  (coreZkRegister-6100-thread-1-processing-n:127.0.0.1:55488_ x:collection1 c:collection1) [n:127.0.0.1:55488_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:55488/collection1/ has no replicas
   [junit4]   2> 1752829 INFO  (coreZkRegister-6100-thread-1-processing-n:127.0.0.1:55488_ x:collection1 c:collection1) [n:127.0.0.1:55488_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1752837 INFO  (coreZkRegister-6100-thread-1-processing-n:127.0.0.1:55488_ x:collection1 c:collection1) [n:127.0.0.1:55488_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55488/collection1/ shard2
   [junit4]   2> 1752942 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1752995 INFO  (coreZkRegister-6100-thread-1-processing-n:127.0.0.1:55488_ x:collection1 c:collection1) [n:127.0.0.1:55488_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1753103 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1753408 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-2-001/cores/collection1
   [junit4]   2> 1753410 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-2-001
   [junit4]   2> 1753411 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1753414 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17fe1ab1{/,null,AVAILABLE}
   [junit4]   2> 1753415 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@52628b07{HTTP/1.1,[http/1.1]}{127.0.0.1:55492}
   [junit4]   2> 1753415 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.Server Started @1759063ms
   [junit4]   2> 1753415 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=55492, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-2-001/cores}
   [junit4]   2> 1753415 ERROR (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1753416 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.6.0
   [junit4]   2> 1753416 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1753417 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1753417 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-04-20T17:41:29.878Z
   [junit4]   2> 1753422 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1753422 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-2-001/solr.xml
   [junit4]   2> 1753437 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1753438 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55479/solr
   [junit4]   2> 1753456 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55492_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1753462 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55492_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1753466 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55492_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55492_
   [junit4]   2> 1753469 INFO  (zkCallback-3735-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1753470 INFO  (zkCallback-3739-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1753470 INFO  (zkCallback-3751-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1753469 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1753608 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55492_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-2-001/cores
   [junit4]   2> 1753608 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55492_    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 1753610 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1753612 INFO  (OverseerStateUpdate-97826248138162180-127.0.0.1:55482_-n_0000000000) [n:127.0.0.1:55482_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1753725 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1753725 INFO  (zkCallback-3751-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1754635 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 1754650 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1754762 WARN  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 1754764 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1754788 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1, trusted=true
   [junit4]   2> 1754789 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1754789 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-2-001/cores/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-2-001/cores/collection1/data/]
   [junit4]   2> 1754789 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@122e5a6a
   [junit4]   2> 1754790 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=6, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.475817991854974]
   [junit4]   2> 1754797 WARN  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1754892 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1754892 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1754897 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1754897 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1754898 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1392177503, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1754898 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@58721010[collection1] main]
   [junit4]   2> 1754901 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1754902 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1754902 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1754903 INFO  (searcherExecutor-6117-thread-1-processing-n:127.0.0.1:55492_ x:collection1 c:collection1) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@58721010[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1754904 INFO  (coreLoadExecutor-6116-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_ c:collection1   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1565219976763146240
   [junit4]   2> 1754915 INFO  (coreZkRegister-6111-thread-1-processing-n:127.0.0.1:55492_ x:collection1 c:collection1) [n:127.0.0.1:55492_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1754915 INFO  (coreZkRegister-6111-thread-1-processing-n:127.0.0.1:55492_ x:collection1 c:collection1) [n:127.0.0.1:55492_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1754916 INFO  (coreZkRegister-6111-thread-1-processing-n:127.0.0.1:55492_ x:collection1 c:collection1) [n:127.0.0.1:55492_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55492/collection1/
   [junit4]   2> 1754916 INFO  (coreZkRegister-6111-thread-1-processing-n:127.0.0.1:55492_ x:collection1 c:collection1) [n:127.0.0.1:55492_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1754916 INFO  (coreZkRegister-6111-thread-1-processing-n:127.0.0.1:55492_ x:collection1 c:collection1) [n:127.0.0.1:55492_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:55492/collection1/ has no replicas
   [junit4]   2> 1754916 INFO  (coreZkRegister-6111-thread-1-processing-n:127.0.0.1:55492_ x:collection1 c:collection1) [n:127.0.0.1:55492_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1754923 INFO  (coreZkRegister-6111-thread-1-processing-n:127.0.0.1:55492_ x:collection1 c:collection1) [n:127.0.0.1:55492_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55492/collection1/ shard1
   [junit4]   2> 1755029 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1755029 INFO  (zkCallback-3751-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1755078 INFO  (coreZkRegister-6111-thread-1-processing-n:127.0.0.1:55492_ x:collection1 c:collection1) [n:127.0.0.1:55492_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1755191 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1755191 INFO  (zkCallback-3751-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1755513 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-3-001/cores/collection1
   [junit4]   2> 1755515 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-3-001
   [junit4]   2> 1755516 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1755518 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3739a212{/,null,AVAILABLE}
   [junit4]   2> 1755518 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5300a7f6{HTTP/1.1,[http/1.1]}{127.0.0.1:55496}
   [junit4]   2> 1755519 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.Server Started @1761167ms
   [junit4]   2> 1755519 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/, hostPort=55496, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-3-001/cores}
   [junit4]   2> 1755519 ERROR (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1755520 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.6.0
   [junit4]   2> 1755520 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1755520 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1755520 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-04-20T17:41:31.981Z
   [junit4]   2> 1755524 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1755524 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-3-001/solr.xml
   [junit4]   2> 1755544 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1755545 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55479/solr
   [junit4]   2> 1755566 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55496_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1755573 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55496_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1755578 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55496_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55496_
   [junit4]   2> 1755581 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1755581 INFO  (zkCallback-3735-thread-1-processing-n:127.0.0.1:55482_) [n:127.0.0.1:55482_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1755583 INFO  (zkCallback-3739-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1755583 INFO  (zkCallback-3751-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1755583 INFO  (zkCallback-3757-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1755773 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55496_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-3-001/cores
   [junit4]   2> 1755773 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55496_    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 1755775 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1755779 INFO  (OverseerStateUpdate-97826248138162180-127.0.0.1:55482_-n_0000000000) [n:127.0.0.1:55482_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 1755891 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1755892 INFO  (zkCallback-3751-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1755892 INFO  (zkCallback-3757-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1756807 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 1756825 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1756948 WARN  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 1756950 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1756975 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1, trusted=true
   [junit4]   2> 1756975 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1756975 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-3-001/cores/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-3-001/cores/collection1/data/]
   [junit4]   2> 1756975 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@122e5a6a
   [junit4]   2> 1756977 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=6, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.475817991854974]
   [junit4]   2> 1756983 WARN  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1757066 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1757067 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1757069 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1757069 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1757070 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1392177503, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1757070 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4e317ae9[collection1] main]
   [junit4]   2> 1757073 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1757074 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1757074 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1757075 INFO  (searcherExecutor-6128-thread-1-processing-n:127.0.0.1:55496_ x:collection1 c:collection1) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4e317ae9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1757076 INFO  (coreLoadExecutor-6127-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_ c:collection1   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1565219979040653312
   [junit4]   2> 1757082 INFO  (coreZkRegister-6122-thread-1-processing-n:127.0.0.1:55496_ x:collection1 c:collection1) [n:127.0.0.1:55496_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
   [junit4]   2> 1757082 INFO  (updateExecutor-3754-thread-1-processing-n:127.0.0.1:55496_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:55496_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 1757082 INFO  (recoveryExecutor-3755-thread-1-processing-n:127.0.0.1:55496_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:55496_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 1757083 INFO  (recoveryExecutor-3755-thread-1-processing-n:127.0.0.1:55496_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:55496_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 1757083 INFO  (recoveryExecutor-3755-thread-1-processing-n:127.0.0.1:55496_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:55496_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
   [junit4]   2> 1757083 INFO  (recoveryExecutor-3755-thread-1-processing-n:127.0.0.1:55496_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:55496_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 1757083 INFO  (recoveryExecutor-3755-thread-1-processing-n:127.0.0.1:55496_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:55496_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:55488/collection1/] and I am [http://127.0.0.1:55496/collection1/]
   [junit4]   2> 1757089 INFO  (recoveryExecutor-3755-thread-1-processing-n:127.0.0.1:55496_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:55496_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:55488]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:55496_&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 1757093 INFO  (qtp611024993-16021) [n:127.0.0.1:55488_    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
   [junit4]   2> 1757094 INFO  (qtp611024993-16021) [n:127.0.0.1:55488_    ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard2 of collection1) have state: recovering
   [junit4]   2> 1757094 INFO  (qtp611024993-16021) [n:127.0.0.1:55488_    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:55496_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"collection1","base_url":"http://127.0.0.1:55496","node_name":"127.0.0.1:55496_","state":"down"}
   [junit4]   2> 1757195 INFO  (zkCallback-3751-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1757195 INFO  (zkCallback-3757-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1757195 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1757639 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-4-001/cores/collection1
   [junit4]   2> 1757640 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-4-001
   [junit4]   2> 1757641 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1757643 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1562033e{/,null,AVAILABLE}
   [junit4]   2> 1757644 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@610bec9b{HTTP/1.1,[http/1.1]}{127.0.0.1:55501}
   [junit4]   2> 1757644 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.e.j.s.Server Started @1763292ms
   [junit4]   2> 1757644 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/tempDir-001/jetty4, solrconfig=solrconfig.xml, hostContext=/, hostPort=55501, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-4-001/cores}
   [junit4]   2> 1757644 ERROR (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1757645 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.6.0
   [junit4]   2> 1757646 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1757646 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1757646 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-04-20T17:41:34.107Z
   [junit4]   2> 1757651 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1757651 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_59432FEA2A186957-001/shard-4-001/solr.xml
   [junit4]   2> 1757690 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1757690 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55479/solr
   [junit4]   2> 1757710 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55501_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1757716 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55501_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1757720 INFO  (TEST-MultiThreadedOCPTest.test-seed#[59432FEA2A186957]) [n:127.0.0.1:55501_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55501_
   [junit4]   2> 1757724 INFO  (zkCallback-3757-thread-1-processing-n:127.0.0.1:55496_) [n:127.0.0.1:55496_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1757725 INFO  (zkCallback-3745-thread-1-processing-n:127.0.0.1:55488_) [n:127.0.0.1:55488_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1757725 INFO  (zkCallback-3751-thread-1-processing-n:127.0.0.1:55492_) [n:127.0.0.1:55492_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1757726 INFO  (zkCallback-3739-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 1757725 INFO  (zkCallback-3735-thread-2-processing-n

[...truncated too long message...]

collection1] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:529&qt=standard&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
   [junit4]   2> 1831593 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1565220057177391104)]} 0 3318
   [junit4]   2> 1831593 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1565220057177391105)]} 0 3318
   [junit4]   2> 1831593 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1565220057177391106)]} 0 3318
   [junit4]   2> 1831594 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1565220057178439680)]} 0 3318
   [junit4]   2> 1831594 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1565220057178439681)]} 0 3319
   [junit4]   2> 1831594 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1565220057178439682)]} 0 3319
   [junit4]   2> 1831594 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1565220057178439683)]} 0 3319
   [junit4]   2> 1831594 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1565220057178439684)]} 0 3319
   [junit4]   2> 1831594 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1565220057178439685)]} 0 3319
   [junit4]   2> 1831595 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[500 (1565220057179488256)]} 0 3319
   [junit4]   2> 1831595 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:500&qt=standard&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
   [junit4]   2> 1833102 INFO  (commitScheduler-6268-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 1833399 INFO  (commitScheduler-6268-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1bd62766[collection1] main]
   [junit4]   2> 1833400 INFO  (commitScheduler-6268-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1833403 INFO  (searcherExecutor-6265-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1bd62766[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(6.6.0):C1) Uninverting(_6(6.6.0):C11/9:delGen=1)))}
   [junit4]   2> 1833637 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {add=[531 (1565220059318583296)]} 0 5362
   [junit4]   2> 1833637 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:500&qt=standard&start=0&rows=20&version=2.2} hits=1 status=0 QTime=0
   [junit4]   2> 1833639 INFO  (TEST-AutoCommitTest.testMaxTime-seed#[59432FEA2A186957]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testMaxTime
   [junit4]   2> 1833639 INFO  (SUITE-AutoCommitTest-seed#[59432FEA2A186957]-worker) [    x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 1833640 INFO  (SUITE-AutoCommitTest-seed#[59432FEA2A186957]-worker) [    x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1026235034
   [junit4]   2> 1833641 INFO  (coreCloseExecutor-6269-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1ec71a01
   [junit4]   2> 1833641 INFO  (coreCloseExecutor-6269-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
   [junit4]   2> 1833641 INFO  (coreCloseExecutor-6269-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6f29eede
   [junit4]   2> 1833729 INFO  (coreCloseExecutor-6269-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 1833730 INFO  (SUITE-AutoCommitTest-seed#[59432FEA2A186957]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.update.AutoCommitTest_59432FEA2A186957-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {range_facet_l_dv=FST50, field_t=FSTOrd50, multiDefault=Lucene50(blocksize=128), subject=Lucene50(blocksize=128), intDefault=PostingsFormat(name=MockRandom), id=FST50, range_facet_i_dv=PostingsFormat(name=MockRandom), text=FSTOrd50, range_facet_l=PostingsFormat(name=MockRandom), timestamp=PostingsFormat(name=MockRandom)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Direct), intDvoDefault=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=1835, maxMBSortInHeap=6.254415105554948, sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=mt, timezone=Europe/Brussels
   [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=3,threads=1,free=211560528,total=503316480
   [junit4]   2> NOTE: All tests run in this JVM: [QueryParsingTest, OverseerTaskQueueTest, DistributedFacetPivotWhiteBoxTest, ShowFileRequestHandlerTest, ChangedSchemaMergeTest, ConvertedLegacyTest, TestMergePolicyConfig, DistributedFacetPivotLargeTest, TestReversedWildcardFilterFactory, TestPHPSerializedResponseWriter, TestCloudSchemaless, TestTolerantUpdateProcessorRandomCloud, DistributedVersionInfoTest, CopyFieldTest, TestOrdValues, ManagedSchemaRoundRobinCloudTest, DebugComponentTest, DefaultValueUpdateProcessorTest, SolrCLIZkUtilsTest, SpellPossibilityIteratorTest, TestRequestStatusCollectionAPI, SSLMigrationTest, CircularListTest, TestSolrCloudWithKerberosAlt, CollectionTooManyReplicasTest, HdfsDirectoryFactoryTest, TestBlobHandler, SpatialHeatmapFacetsTest, RulesTest, StatsComponentTest, TestExceedMaxTermLength, BasicFunctionalityTest, TestSolrCoreProperties, HdfsLockFactoryTest, TestLuceneMatchVersion, TestQueryUtils, TestSolrQueryParser, TestCloudRecovery, DeleteNodeTest, TestFieldCache, TestSystemIdResolver, BadIndexSchemaTest, BasicDistributedZk2Test, OutOfBoxZkACLAndCredentialsProvidersTest, SolrSlf4jReporterTest, TestManagedStopFilterFactory, SecurityConfHandlerTest, CdcrBootstrapTest, TestGraphTermsQParserPlugin, LoggingHandlerTest, TestReloadAndDeleteDocs, TestCoreAdminApis, TestReplicaProperties, ChaosMonkeySafeLeaderTest, LeaderElectionContextKeyTest, BadCopyFieldTest, OverseerCollectionConfigSetProcessorTest, DistributedExpandComponentTest, DataDrivenBlockJoinTest, AsyncCallRequestStatusResponseTest, RecoveryAfterSoftCommitTest, DirectoryFactoryTest, ResponseHeaderTest, MinimalSchemaTest, TestCrossCoreJoin, SharedFSAutoReplicaFailoverUtilsTest, CleanupOldIndexTest, ReturnFieldsTest, TestTrie, TestFieldCacheSortRandom, TestSolrConfigHandler, TestReqParamsAPI, SearchHandlerTest, TestDistributedMissingSort, FieldAnalysisRequestHandlerTest, DirectUpdateHandlerOptimizeTest, ConnectionReuseTest, SuggesterTest, RequestHandlersTest, TestXmlQParserPlugin, TestPathTrie, AddSchemaFieldsUpdateProcessorFactoryTest, TestSolrConfigHandlerCloud, TestIndexingPerformance, TestHdfsBackupRestoreCore, CoreAdminCreateDiscoverTest, TestSizeLimitedDistributedMap, TestCopyFieldCollectionResource, TestConfigSets, TestSlowCompositeReaderWrapper, TestSchemaSimilarityResource, TestSolrCoreParser, TestInitParams, TestDistributedGrouping, ReplicaListTransformerTest, TestAtomicUpdateErrorCases, TestOnReconnectListenerSupport, HdfsCollectionsAPIDistributedZkTest, CoreMergeIndexesAdminHandlerTest, TestBadConfig, BJQParserTest, PreAnalyzedFieldTest, TestUtils, CoreAdminHandlerTest, TestBackupRepositoryFactory, DistributedQueryComponentOptimizationTest, TestTestInjection, TestRangeQuery, UpdateParamsTest, TestFastWriter, FullSolrCloudDistribCmdsTest, TestDefaultStatsCache, StressHdfsTest, TestSerializedLuceneMatchVersion, SolrIndexSplitterTest, CheckHdfsIndexTest, TestSearchPerf, HdfsRestartWhileUpdatingTest, FacetPivotSmallTest, HdfsThreadLeakTest, MetricsHandlerTest, MergeStrategyTest, JsonValidatorTest, TestStandardQParsers, TestStressLiveNodes, SolrGraphiteReporterTest, BasicAuthStandaloneTest, CloudMLTQParserTest, CdcrReplicationHandlerTest, TestCloudManagedSchema, TestExclusionRuleCollectionAccess, TestSolrDeletionPolicy2, TestImplicitCoreProperties, TestBlendedInfixSuggestions, BufferStoreTest, TestCloudDeleteByQuery, TestDistribDocBasedVersion, TestRandomFaceting, TestReload, FileBasedSpellCheckerTest, TestCodecSupport, JvmMetricsTest, TestFuzzyAnalyzedSuggestions, DocValuesMissingTest, TestDFRSimilarityFactory, RestartWhileUpdatingTest, TestLMJelinekMercerSimilarityFactory, AnalyticsMergeStrategyTest, MultiThreadedOCPTest, AutoCommitTest]
   [junit4] Completed [332/704 (3!)] on J1 in 32.19s, 3 tests, 1 failure <<< FAILURES!

[...truncated 44561 lines...]



---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[JENKINS] Lucene-Solr-6.x-MacOSX (64bit/jdk1.8.0) - Build # 826 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/826/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC

95 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.MinimalSchemaTest

Error Message:
org.apache.solr.MinimalSchemaTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.MinimalSchemaTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/MinimalSchemaTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.api.TestPathTrie

Error Message:
org.apache.solr.api.TestPathTrie

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.api.TestPathTrie
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/api/TestPathTrie.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.impl.ConnectionReuseTest

Error Message:
org.apache.solr.client.solrj.impl.ConnectionReuseTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.client.solrj.impl.ConnectionReuseTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/client/solrj/impl/ConnectionReuseTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.test

Error Message:
java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO

Stack Trace:
org.apache.solr.common.SolrException: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO
        at __randomizedtesting.SeedInfo.seed([70A6315911B648B8:F8F20E83BF4A2540]:0)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:170)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:116)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:106)
        at org.apache.solr.common.cloud.ZkStateReader.<init>(ZkStateReader.java:226)
        at org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider.connect(ZkClientClusterStateProvider.java:131)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.connect(CloudSolrClient.java:631)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.initCloud(AbstractFullDistribZkTestBase.java:267)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:329)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:990)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO
        at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1782)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:447)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380)
        at org.apache.solr.common.cloud.SolrZooKeeper.<init>(SolrZooKeeper.java:43)
        at org.apache.solr.common.cloud.ZkClientConnectionStrategy.createSolrZooKeeper(ZkClientConnectionStrategy.java:105)
        at org.apache.solr.common.cloud.DefaultConnectionStrategy.connect(DefaultConnectionStrategy.java:37)
        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:145)
        ... 40 more
Caused by: java.io.IOException: Too many open files
        at sun.nio.ch.IOUtil.makePipe(Native Method)
        at sun.nio.ch.KQueueSelectorImpl.<init>(KQueueSelectorImpl.java:84)
        at sun.nio.ch.KQueueSelectorProvider.openSelector(KQueueSelectorProvider.java:42)
        at java.nio.channels.Selector.open(Selector.java:227)
        at org.apache.zookeeper.ClientCnxnSocketNIO.<init>(ClientCnxnSocketNIO.java:43)
        at sun.reflect.GeneratedConstructorAccessor24.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at java.lang.Class.newInstance(Class.java:442)
        at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1779)
        ... 46 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest

Error Message:
org.apache.solr.cloud.BasicDistributedZkTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.BasicDistributedZkTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/BasicDistributedZkTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPISolrJTest

Error Message:
org.apache.solr.cloud.CollectionsAPISolrJTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.CollectionsAPISolrJTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/CollectionsAPISolrJTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  org.apache.solr.cloud.CustomCollectionTest.testCreateShardRepFactor

Error Message:
Error from server at http://127.0.0.1:62651/solr: Could not find collection : testCreateShardRepFactor

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:62651/solr: Could not find collection : testCreateShardRepFactor
        at __randomizedtesting.SeedInfo.seed([70A6315911B648B8:8448BBDD09E25D78]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:447)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:388)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1383)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1134)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1073)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:177)
        at org.apache.solr.cloud.CustomCollectionTest.testCreateShardRepFactor(CustomCollectionTest.java:190)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForHashRouter

Error Message:
Collection not found: routeFieldColl

Stack Trace:
org.apache.solr.common.SolrException: Collection not found: routeFieldColl
        at __randomizedtesting.SeedInfo.seed([70A6315911B648B8:D890AF848ED7A3E2]:0)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.getCollectionNames(CloudSolrClient.java:1401)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1094)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1073)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160)
        at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
        at org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForHashRouter(CustomCollectionTest.java:166)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ForceLeaderTest

Error Message:
org.apache.solr.cloud.ForceLeaderTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.ForceLeaderTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/ForceLeaderTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test

Error Message:
Could not find collection:collection2

Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
        at __randomizedtesting.SeedInfo.seed([70A6315911B648B8:F8F20E83BF4A2540]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:159)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:144)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:139)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:856)
        at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:620)
        at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.OverseerTaskQueueTest

Error Message:
org.apache.solr.cloud.OverseerTaskQueueTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.OverseerTaskQueueTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/OverseerTaskQueueTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ReplaceNodeTest

Error Message:
org.apache.solr.cloud.ReplaceNodeTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.ReplaceNodeTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/ReplaceNodeTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.SolrCLIZkUtilsTest

Error Message:
org.apache.solr.cloud.SolrCLIZkUtilsTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.SolrCLIZkUtilsTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/SolrCLIZkUtilsTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCloudRecovery

Error Message:
org.apache.solr.cloud.TestCloudRecovery

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.TestCloudRecovery
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/TestCloudRecovery.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCollectionAPI

Error Message:
org.apache.solr.cloud.TestCollectionAPI

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.TestCollectionAPI
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/TestCollectionAPI.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCryptoKeys

Error Message:
org.apache.solr.cloud.TestCryptoKeys

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.TestCryptoKeys
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/TestCryptoKeys.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestDistribDocBasedVersion

Error Message:
org.apache.solr.cloud.TestDistribDocBasedVersion

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.TestDistribDocBasedVersion
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/TestDistribDocBasedVersion.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestExclusionRuleCollectionAccess

Error Message:
org.apache.solr.cloud.TestExclusionRuleCollectionAccess

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.TestExclusionRuleCollectionAccess
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/TestExclusionRuleCollectionAccess.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestRequestStatusCollectionAPI

Error Message:
org.apache.solr.cloud.TestRequestStatusCollectionAPI

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.TestRequestStatusCollectionAPI
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/TestRequestStatusCollectionAPI.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TriLevelCompositeIdRoutingTest

Error Message:
org.apache.solr.cloud.TriLevelCompositeIdRoutingTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.TriLevelCompositeIdRoutingTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/TriLevelCompositeIdRoutingTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  org.apache.solr.cloud.UnloadDistributedZkTest.test

Error Message:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml (Too many open files)

Stack Trace:
java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml (Too many open files)
        at __randomizedtesting.SeedInfo.seed([70A6315911B648B8:F8F20E83BF4A2540]:0)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:294)
        at org.apache.commons.io.FileUtils.readFileToByteArray(FileUtils.java:1815)
        at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:419)
        at org.apache.solr.cloud.AbstractZkTestCase.putConfig(AbstractZkTestCase.java:133)
        at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:102)
        at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:80)
        at org.apache.solr.cloud.AbstractDistribZkTestBase.distribSetUp(AbstractDistribZkTestBase.java:80)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.distribSetUp(AbstractFullDistribZkTestBase.java:218)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:962)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.UnloadDistributedZkTest

Error Message:
7 threads leaked from SUITE scope at org.apache.solr.cloud.UnloadDistributedZkTest:     1) Thread[id=7904, name=SessionTracker, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest]         at java.lang.Object.wait(Native Method)         at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146)    2) Thread[id=7910, name=TEST-UnloadDistributedZkTest.test-seed#[70A6315911B648B8]-SendThread(127.0.0.1:62027), state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)    3) Thread[id=7911, name=TEST-UnloadDistributedZkTest.test-seed#[70A6315911B648B8]-EventThread, state=WAITING, group=TGRP-UnloadDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)    4) Thread[id=7912, name=zkCallback-1305-thread-1, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    5) Thread[id=7902, name=Thread-1796, state=WAITING, group=TGRP-UnloadDistributedZkTest]         at java.lang.Object.wait(Native Method)         at java.lang.Thread.join(Thread.java:1249)         at java.lang.Thread.join(Thread.java:1323)         at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:302)         at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:309)         at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:490)    6) Thread[id=7906, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-UnloadDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120)    7) Thread[id=7903, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 7 threads leaked from SUITE scope at org.apache.solr.cloud.UnloadDistributedZkTest:
   1) Thread[id=7904, name=SessionTracker, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest]
        at java.lang.Object.wait(Native Method)
        at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146)
   2) Thread[id=7910, name=TEST-UnloadDistributedZkTest.test-seed#[70A6315911B648B8]-SendThread(127.0.0.1:62027), state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   3) Thread[id=7911, name=TEST-UnloadDistributedZkTest.test-seed#[70A6315911B648B8]-EventThread, state=WAITING, group=TGRP-UnloadDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
   4) Thread[id=7912, name=zkCallback-1305-thread-1, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   5) Thread[id=7902, name=Thread-1796, state=WAITING, group=TGRP-UnloadDistributedZkTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1249)
        at java.lang.Thread.join(Thread.java:1323)
        at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:302)
        at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:309)
        at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:490)
   6) Thread[id=7906, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-UnloadDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120)
   7) Thread[id=7903, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([70A6315911B648B8]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.UnloadDistributedZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=7910, name=TEST-UnloadDistributedZkTest.test-seed#[70A6315911B648B8]-SendThread(127.0.0.1:62027), state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]         at sun.nio.ch.KQueueArrayWrapper.interrupt(Native Method)         at sun.nio.ch.KQueueArrayWrapper.interrupt(KQueueArrayWrapper.java:203)         at sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:257)         at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)         at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:116)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)    2) Thread[id=7912, name=zkCallback-1305-thread-1, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    3) Thread[id=7903, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]         at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)         at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)         at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=7910, name=TEST-UnloadDistributedZkTest.test-seed#[70A6315911B648B8]-SendThread(127.0.0.1:62027), state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]
        at sun.nio.ch.KQueueArrayWrapper.interrupt(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.interrupt(KQueueArrayWrapper.java:203)
        at sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:257)
        at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
        at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:116)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   2) Thread[id=7912, name=zkCallback-1305-thread-1, state=TIMED_WAITING, group=TGRP-UnloadDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=7903, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([70A6315911B648B8]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsThreadLeakTest

Error Message:
org.apache.solr.cloud.hdfs.HdfsThreadLeakTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.hdfs.HdfsThreadLeakTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/hdfs/HdfsThreadLeakTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.rule.ImplicitSnitchTest

Error Message:
org.apache.solr.cloud.rule.ImplicitSnitchTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.cloud.rule.ImplicitSnitchTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/cloud/rule/ImplicitSnitchTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.core.HdfsDirectoryFactoryTest

Error Message:
org.apache.solr.core.HdfsDirectoryFactoryTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.core.HdfsDirectoryFactoryTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/core/HdfsDirectoryFactoryTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.core.OpenCloseCoreStressTest

Error Message:
org.apache.solr.core.OpenCloseCoreStressTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.core.OpenCloseCoreStressTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/core/OpenCloseCoreStressTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.core.RequestHandlersTest

Error Message:
org.apache.solr.core.RequestHandlersTest

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.core.RequestHandlersTest
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/core/RequestHandlersTest.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestCodecSupport

Error Message:
org.apache.solr.core.TestCodecSupport

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.core.TestCodecSupport
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/core/TestCodecSupport.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestCoreDiscovery

Error Message:
org.apache.solr.core.TestCoreDiscovery

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.core.TestCoreDiscovery
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/core/TestCoreDiscovery.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestInitParams

Error Message:
org.apache.solr.core.TestInitParams

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.core.TestInitParams
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/core/TestInitParams.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestReloadAndDeleteDocs

Error Message:
org.apache.solr.core.TestReloadAndDeleteDocs

Stack Trace:
java.lang.ClassNotFoundException: org.apache.solr.core.TestReloadAndDeleteDocs
        at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.instantiate(SlaveMain.java:273)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:233)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:355)
        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/core/TestReloadAndDeleteDocs.class (Too many open files)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
        at sun.misc.Resource.cachedInputStream(Resource.java:77)
        at sun.misc.Resource.getByteBuffer(Resource.java:160)
        at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
        at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
        ... 12 more


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.JsonLoaderTest

Error Message:
invalid API spec: apispec/cores.core.Commands.json

Stack Trace:
java.lang.RuntimeException: invalid API spec: apispec/cores.core.Commands.json
        at __randomizedtesting.SeedInfo.seed([70A6315911B648B8]:0)
        at org.apache.solr.common.util.ValidatingJsonMap.parse(ValidatingJsonMap.java:318)
        at org.apache.solr.api.ApiBag.lambda$getSpec$0(ApiBag.java:229)
        at org.apache.solr.api.Api.getSpec(Api.java:64)
        at org.apache.solr.api.ApiBag.register(ApiBag.java:72)
        at org.apache.solr.core.PluginBag.put(PluginBag.java:215)
        at org.apache.solr.core.PluginBag.put(PluginBag.java:186)
        at org.apache.solr.core.CoreContainer.createHandler(CoreContainer.java:1332)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:490)
        at org.apache.solr.util.TestHarness.<init>(TestHarness.java:177)
        at org.apache.solr.util.TestHarness.<init>(TestHarness.java:140)
        at org.apache.solr.util.TestHarness.<init>(TestHarness.java:146)
        at org.apache.solr.util.TestHarness.<init>(TestHarness.java:109)
        at org.apache.solr.SolrTestCaseJ4.createCore(SolrTestCaseJ4.java:705)
        at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:695)
        at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:569)
        at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:558)
        at org.apache.solr.handler.JsonLoaderTest.beforeTests(JsonLoaderTest.java:40)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:847)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.JsonLoaderTest

Error Message:
Could not remove the following files (in the order of attempts):    /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.JsonLoaderTest_70A6315911B648B8-001/init-core-data-001: java.nio.file.FileSystemException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.JsonLoaderTest_70A6315911B648B8-001/init-core-data-001: Too many open files    /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.JsonLoaderTest_70A6315911B648B8-001: java.nio.file.FileSystemException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.JsonLoaderTest_70A6315911B648B8-001: Too many open files

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.JsonLoaderTest_70A6315911B648B8-001/init-core-data-001: java.nio.file.FileSystemException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.hand

[...truncated too long message...]

t, SampleTest, TestSolrIndexConfig, CachingDirectoryFactoryTest, TestStressRecovery, SchemaVersionSpecificBehaviorTest, TestFieldResource, TestFieldCacheVsDocValues, SharedFSAutoReplicaFailoverTest, TestManagedResource, DeleteStatusTest, HdfsDirectoryTest, OpenExchangeRatesOrgProviderTest, TestDefaultSearchFieldResource, HdfsBasicDistributedZkTest, TestRTGBase, InfoHandlerTest, RemoteQueryErrorTest, EnumFieldTest, TimeZoneUtilsTest, RollingRestartTest, TestMiniSolrCloudCluster, ShufflingReplicaListTransformerTest, TestLocalFSCloudBackupRestore, SolrCloudExampleTest, TestStressVersions, V2ApiIntegrationTest, ConjunctionSolrSpellCheckerTest, TestExtendedDismaxParser, FastVectorHighlighterTest, TestXIncludeConfig, DocumentAnalysisRequestHandlerTest, ChaosMonkeyNothingIsSafeTest, AddBlockUpdateTest, TestCSVResponseWriter, TestJmxIntegration, TestSSLRandomization, TestImpersonationWithHadoopAuth, BadComponentTest, ExitableDirectoryReaderTest, JSONWriterTest, QueryElevationComponentTest, DistributedDebugComponentTest, CollectionsAPIAsyncDistributedZkTest, TestRestManager, SimpleFacetsTest, TestBinaryField, DistributedMLTComponentTest, PingRequestHandlerTest, DistributedFacetExistsSmallTest, JSONWriterTest, QueryResultKeyTest, TestSolrDeletionPolicy1, SparseHLLTest, TestComponentsName, TestManagedSchemaAPI, SystemInfoHandlerTest, TestBulkSchemaConcurrent, DistributedFacetPivotSmallTest, TestSolrCloudWithDelegationTokens, TlogReplayBufferedWhileIndexingTest, TestCollationField, BlockDirectoryTest, TestStressReorder, TestCursorMarkWithoutUniqueKey, DistributedSpellCheckComponentTest, DeleteLastCustomShardedReplicaTest, AnalysisAfterCoreReloadTest, SmileWriterTest, StandardRequestHandlerTest, SolrCoreMetricManagerTest, LargeFieldTest, IndexBasedSpellCheckerTest, TestSha256AuthenticationProvider, ConcurrentDeleteAndCreateCollectionTest, TestSort, TestConfigReload, TestConfigSetsAPIZkFailure, CoreSorterTest, TestRandomDVFaceting, SimplePostToolTest, SyncSliceTest, TestLazyCores, TestAuthenticationFramework, HdfsNNFailoverTest, TestMaxScoreQueryParser, DateFieldTest, TestSolrJ, SOLR749Test, ZkStateWriterTest, PeerSyncTest, ClusterStateUpdateTest, TestNRTOpen, AnalyticsQueryTest, BaseCdcrDistributedZkTest, HdfsRecoveryZkTest, TestLRUCache, TestSweetSpotSimilarityFactory, TestLeaderElectionZkExpiry, XsltUpdateRequestHandlerTest, TestStressLucene, TestRandomCollapseQParserPlugin, DirectSolrSpellCheckerTest, ShardRoutingTest, MultiTermTest, CloudExitableDirectoryReaderTest, TestPointFields, ZkNodePropsTest, TestExactStatsCache, DocValuesNotIndexedTest, TestSolrConfigHandlerConcurrent, TestFileDictionaryLookup, SolrCoreTest, SuggestComponentContextFilterQueryTest, TestSQLHandlerNonCloud, WrapperMergePolicyFactoryTest, TestMultiWordSynonyms, PluginInfoTest, TestSolrCloudSnapshots, TestSolrDynamicMBean, TestSolrFieldCacheMBean, TestDownShardTolerantSearch, DocumentBuilderTest, TestSolrCloudWithSecureImpersonation, TestReloadDeadlock, TestHighlightDedupGrouping, OverriddenZkACLAndCredentialsProvidersTest, TestCloudPseudoReturnFields, RecoveryZkTest, PolyFieldTest, SimpleMLTQParserTest, BlockJoinFacetDistribTest, TestManagedSynonymFilterFactory, RequestLoggingTest, HLLSerializationTest, PropertiesRequestHandlerTest, TestHdfsUpdateLog, TestSchemalessBufferedUpdates, TestUnifiedSolrHighlighter, TestStressInPlaceUpdates, DateRangeFieldTest, TestRequestForwarding, TestCharFilters, PreAnalyzedUpdateProcessorTest, JavabinLoaderTest, TestFilteredDocIdSet, TestDistributedStatsComponentCardinality, UtilsToolTest, TestDocTermOrds, TestPhraseSuggestions, HttpSolrCallGetCoreTest, TestComplexPhraseLeadingWildcard, TestShortCircuitedRequests, TestScoreJoinQPNoScore, AlternateDirectoryTest, TestStressUserVersions, TestPseudoReturnFields, TemplateUpdateProcessorTest, TestSimpleQParserPlugin, PathHierarchyTokenizerFactoryTest, TestConfigSetProperties, QueryEqualityTest, TestConfigsApi, TestDistribIDF, CustomCollectionTest, TestHashQParserPlugin]
   [junit4] Completed [701/704 (81!)] on J0 in 0.71s, 1 test, 1 error <<< FAILURES!

[...truncated 1 lines...]
   [junit4] Suite: org.apache.solr.search.TestSolr4Spatial2
   [junit4] ERROR   0.00s J0 | TestSolr4Spatial2 (suite) <<<
   [junit4]    > Throwable #1: java.lang.ClassNotFoundException: org.apache.solr.search.TestSolr4Spatial2
   [junit4]    > at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
   [junit4]    > at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
   [junit4]    > at java.security.AccessController.doPrivileged(Native Method)
   [junit4]    > at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
   [junit4]    > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
   [junit4]    > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
   [junit4]    > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
   [junit4]    > at java.lang.Class.forName0(Native Method)
   [junit4]    > at java.lang.Class.forName(Class.java:348)
   [junit4]    > Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/search/TestSolr4Spatial2.class (Too many open files)
   [junit4]    > at java.io.FileInputStream.open0(Native Method)
   [junit4]    > at java.io.FileInputStream.open(FileInputStream.java:195)
   [junit4]    > at java.io.FileInputStream.<init>(FileInputStream.java:138)
   [junit4]    > at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
   [junit4]    > at sun.misc.Resource.cachedInputStream(Resource.java:77)
   [junit4]    > at sun.misc.Resource.getByteBuffer(Resource.java:160)
   [junit4]    > at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
   [junit4]    > at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
   [junit4]    > at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
   [junit4]    > ... 12 more
   [junit4] Completed [702/704 (82!)] on J0 in 0.00s, 0 tests, 1 error <<< FAILURES!

[...truncated 1 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
   [junit4] ERROR   0.00s J0 | TestReplicationHandler (suite) <<<
   [junit4]    > Throwable #1: java.lang.ClassNotFoundException: org.apache.solr.handler.TestReplicationHandler
   [junit4]    > at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
   [junit4]    > at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
   [junit4]    > at java.security.AccessController.doPrivileged(Native Method)
   [junit4]    > at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
   [junit4]    > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
   [junit4]    > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
   [junit4]    > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
   [junit4]    > at java.lang.Class.forName0(Native Method)
   [junit4]    > at java.lang.Class.forName(Class.java:348)
   [junit4]    > Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/handler/TestReplicationHandler.class (Too many open files)
   [junit4]    > at java.io.FileInputStream.open0(Native Method)
   [junit4]    > at java.io.FileInputStream.open(FileInputStream.java:195)
   [junit4]    > at java.io.FileInputStream.<init>(FileInputStream.java:138)
   [junit4]    > at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
   [junit4]    > at sun.misc.Resource.cachedInputStream(Resource.java:77)
   [junit4]    > at sun.misc.Resource.getByteBuffer(Resource.java:160)
   [junit4]    > at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
   [junit4]    > at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
   [junit4]    > at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
   [junit4]    > ... 12 more
   [junit4] Completed [703/704 (83!)] on J0 in 0.00s, 0 tests, 1 error <<< FAILURES!

[...truncated 1 lines...]
   [junit4] Suite: org.apache.solr.rest.schema.TestDynamicFieldResource
   [junit4] ERROR   0.00s J0 | TestDynamicFieldResource (suite) <<<
   [junit4]    > Throwable #1: java.lang.ClassNotFoundException: org.apache.solr.rest.schema.TestDynamicFieldResource
   [junit4]    > at java.net.URLClassLoader$1.run(URLClassLoader.java:370)
   [junit4]    > at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
   [junit4]    > at java.security.AccessController.doPrivileged(Native Method)
   [junit4]    > at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
   [junit4]    > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
   [junit4]    > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
   [junit4]    > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
   [junit4]    > at java.lang.Class.forName0(Native Method)
   [junit4]    > at java.lang.Class.forName(Class.java:348)
   [junit4]    > Caused by: java.io.FileNotFoundException: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/test/org/apache/solr/rest/schema/TestDynamicFieldResource.class (Too many open files)
   [junit4]    > at java.io.FileInputStream.open0(Native Method)
   [junit4]    > at java.io.FileInputStream.open(FileInputStream.java:195)
   [junit4]    > at java.io.FileInputStream.<init>(FileInputStream.java:138)
   [junit4]    > at sun.misc.URLClassPath$FileLoader$1.getInputStream(URLClassPath.java:1288)
   [junit4]    > at sun.misc.Resource.cachedInputStream(Resource.java:77)
   [junit4]    > at sun.misc.Resource.getByteBuffer(Resource.java:160)
   [junit4]    > at java.net.URLClassLoader.defineClass(URLClassLoader.java:454)
   [junit4]    > at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
   [junit4]    > at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
   [junit4]    > ... 12 more
   [junit4] Completed [704/704 (84!)] on J0 in 0.00s, 0 tests, 1 error <<< FAILURES!

[...truncated 43414 lines...]



---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[JENKINS] Lucene-Solr-6.x-MacOSX (64bit/jdk1.8.0) - Build # 827 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/827/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.schema.TestUseDocValuesAsStored.testMultipleSearchResults

Error Message:
mismatch: 'myid1'!='myid' @ response/docs/[0]/id

Stack Trace:
java.lang.RuntimeException: mismatch: 'myid1'!='myid' @ response/docs/[0]/id
        at __randomizedtesting.SeedInfo.seed([E7F98B92BAB3A8DE:D5D38C0C424D8C07]:0)
        at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:983)
        at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:930)
        at org.apache.solr.schema.TestUseDocValuesAsStored.testMultipleSearchResults(TestUseDocValuesAsStored.java:243)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 13027 lines...]
   [junit4] Suite: org.apache.solr.schema.TestUseDocValuesAsStored
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/init-core-data-001
   [junit4]   2> 4782017 WARN  (SUITE-TestUseDocValuesAsStored-seed#[E7F98B92BAB3A8DE]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1929 numCloses=1929
   [junit4]   2> 4782019 INFO  (SUITE-TestUseDocValuesAsStored-seed#[E7F98B92BAB3A8DE]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields
   [junit4]   2> 4782027 INFO  (SUITE-TestUseDocValuesAsStored-seed#[E7F98B92BAB3A8DE]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 4782029 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testUseDocValuesAsStoredFalse
   [junit4]   2> 4782045 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 4782076 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 4782099 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema-non-stored-docvalues.xml instead
   [junit4]   2> 4782104 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.IndexSchema [null] Schema name=test-non-stored-docvalues
   [junit4]   2> 4782118 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.IndexSchema Loaded schema test-non-stored-docvalues/1.6 with uniqueid field id
   [junit4]   2> 4782120 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-001/collection1/conf/managed-schema
   [junit4]   2> 4782125 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema, renamed the non-managed schema /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-001/collection1/conf/schema-non-stored-docvalues.xml to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-001/collection1/conf/schema-non-stored-docvalues.xml.bak
   [junit4]   2> 4782134 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=true
   [junit4]   2> 4782741 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4782750 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4782751 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4782789 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 4782797 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test-non-stored-docvalues
   [junit4]   2> 4782812 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test-non-stored-docvalues/1.6 with uniqueid field id
   [junit4]   2> 4782812 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-001/collection1, trusted=true
   [junit4]   2> 4782813 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4782814 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 4782814 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-001/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/init-core-data-001/]
   [junit4]   2> 4782819 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11235207973829767]
   [junit4]   2> 4782838 WARN  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, registerPath=/solr,/v2, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 4782999 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 4782999 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 4783001 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=4.705078125, floorSegmentMB=1.4716796875, forceMergeDeletesPctAllowed=3.5399957055908313, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5890758213813347
   [junit4]   2> 4783014 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@78d89c6b[collection1] main]
   [junit4]   2> 4783015 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-001/collection1/conf
   [junit4]   2> 4783016 INFO  (coreLoadExecutor-9838-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 4783016 INFO  (searcherExecutor-9839-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@78d89c6b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 4783018 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 4783020 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[myid]} 0 1
   [junit4]   2> 4783029 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4783029 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6a1ed0b2
   [junit4]   2> 4783060 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@28dc6871[collection1] main]
   [junit4]   2> 4783061 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4783061 INFO  (searcherExecutor-9839-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@28dc6871[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.6.0):C1)))}
   [junit4]   2> 4783061 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 32
   [junit4]   2> 4783062 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:myid&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4783062 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:myid&fl=*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4783063 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:myid&fl=id,nonstored_dv_*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4783063 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:myid&fl=id,nonstored_dv_str&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4783064 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 4783064 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 4783064 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 4783064 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=174330225
   [junit4]   2> 4783065 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 4783065 INFO  (coreCloseExecutor-9843-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5a74a846
   [junit4]   2> 4783081 INFO  (coreCloseExecutor-9843-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 4783087 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 4783088 INFO  (TEST-TestUseDocValuesAsStored.testUseDocValuesAsStoredFalse-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testUseDocValuesAsStoredFalse
   [junit4]   2> 4783090 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMultipleSearchResults
   [junit4]   2> 4783097 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 4783165 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 4783178 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema-non-stored-docvalues.xml instead
   [junit4]   2> 4783182 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.IndexSchema [null] Schema name=test-non-stored-docvalues
   [junit4]   2> 4783204 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.IndexSchema Loaded schema test-non-stored-docvalues/1.6 with uniqueid field id
   [junit4]   2> 4783205 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-002/collection1/conf/managed-schema
   [junit4]   2> 4783220 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema, renamed the non-managed schema /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-002/collection1/conf/schema-non-stored-docvalues.xml to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-002/collection1/conf/schema-non-stored-docvalues.xml.bak
   [junit4]   2> 4783224 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=true
   [junit4]   2> 4783320 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4783328 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4783329 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4783354 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 4783368 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test-non-stored-docvalues
   [junit4]   2> 4783383 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test-non-stored-docvalues/1.6 with uniqueid field id
   [junit4]   2> 4783384 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-002/collection1, trusted=true
   [junit4]   2> 4783384 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4783384 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 4783384 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-002/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/init-core-data-001/]
   [junit4]   2> 4783392 WARN  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, registerPath=/solr,/v2, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 4783522 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 4783522 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 4783524 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11235207973829767]
   [junit4]   2> 4783609 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@409984ac[collection1] main]
   [junit4]   2> 4783610 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-002/collection1/conf
   [junit4]   2> 4783610 INFO  (coreLoadExecutor-9850-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 4783610 INFO  (searcherExecutor-9851-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@409984ac[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.6.0):C1)))}
   [junit4]   2> 4783611 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 4783613 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[myid1]} 0 1
   [junit4]   2> 4783613 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[myid2]} 0 0
   [junit4]   2> 4783629 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[myid3]} 0 0
   [junit4]   2> 4783629 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[myid4]} 0 0
   [junit4]   2> 4783630 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[myid5]} 0 0
   [junit4]   2> 4783630 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[myid6]} 0 0
   [junit4]   2> 4783630 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4783630 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@6ee47259
   [junit4]   2> 4783716 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2a95f1c5[collection1] main]
   [junit4]   2> 4783716 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4783716 INFO  (searcherExecutor-9851-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2a95f1c5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.6.0):C1) Uninverting(_1(6.6.0):C6)))}
   [junit4]   2> 4783717 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 86
   [junit4]   2> 4783719 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:myid*&fl=*&wt=xml} hits=7 status=0 QTime=1
   [junit4]   2> 4783720 ERROR (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 query failed JSON validation. error=mismatch: 'myid1'!='myid' @ response/docs/[0]/id
   [junit4]   2>  expected =/response/docs==[{'id':'myid1','test_is_dvo':[101,102,103]},{'id':'myid2','test_is_dvo':[201,202]},{'id':'myid3','test_is_dvo':[301,302,303,304]},{'id':'myid4','test_s_dvo':'hello','test_is_dvo':[401,402]},{'id':'myid5'},{'id':'myid6','test_s_dvo':'hello'}]
   [junit4]   2>  response = {
   [junit4]   2>   "responseHeader":{
   [junit4]   2>     "status":0,
   [junit4]   2>     "QTime":1},
   [junit4]   2>   "response":{"numFound":7,"start":0,"docs":[
   [junit4]   2>       {
   [junit4]   2>         "id":"myid"},
   [junit4]   2>       {
   [junit4]   2>         "id":"myid1",
   [junit4]   2>         "test_is_dvo":[101,
   [junit4]   2>           102,
   [junit4]   2>           103]},
   [junit4]   2>       {
   [junit4]   2>         "id":"myid2",
   [junit4]   2>         "test_is_dvo":[201,
   [junit4]   2>           202]},
   [junit4]   2>       {
   [junit4]   2>         "id":"myid3",
   [junit4]   2>         "test_is_dvo":[301,
   [junit4]   2>           302,
   [junit4]   2>           303,
   [junit4]   2>           304]},
   [junit4]   2>       {
   [junit4]   2>         "id":"myid4",
   [junit4]   2>         "test_s_dvo":"hello",
   [junit4]   2>         "test_is_dvo":[401,
   [junit4]   2>           402]},
   [junit4]   2>       {
   [junit4]   2>         "id":"myid5"},
   [junit4]   2>       {
   [junit4]   2>         "id":"myid6",
   [junit4]   2>         "test_s_dvo":"hello"}]
   [junit4]   2>   }}
   [junit4]   2>
   [junit4]   2>  request = q=id:myid*&fl=*&wt=xml
   [junit4]   2> 4783721 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 4783721 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 4783721 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 4783721 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1276675770
   [junit4]   2> 4783722 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 4783722 INFO  (coreCloseExecutor-9855-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6ad0dafd
   [junit4]   2> 4783745 INFO  (coreCloseExecutor-9855-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 4783749 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 4783751 INFO  (TEST-TestUseDocValuesAsStored.testMultipleSearchResults-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMultipleSearchResults
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestUseDocValuesAsStored -Dtests.method=testMultipleSearchResults -Dtests.seed=E7F98B92BAB3A8DE -Dtests.slow=true -Dtests.locale=uk-UA -Dtests.timezone=Pacific/Nauru -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.67s J0 | TestUseDocValuesAsStored.testMultipleSearchResults <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: mismatch: 'myid1'!='myid' @ response/docs/[0]/id
   [junit4]    > at __randomizedtesting.SeedInfo.seed([E7F98B92BAB3A8DE:D5D38C0C424D8C07]:0)
   [junit4]    > at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:983)
   [junit4]    > at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:930)
   [junit4]    > at org.apache.solr.schema.TestUseDocValuesAsStored.testMultipleSearchResults(TestUseDocValuesAsStored.java:243)
   [junit4]    > at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 4783760 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testManagedSchema
   [junit4]   2> 4783769 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 4783801 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 4783814 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema-non-stored-docvalues.xml instead
   [junit4]   2> 4783818 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.IndexSchema [null] Schema name=test-non-stored-docvalues
   [junit4]   2> 4783846 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.IndexSchema Loaded schema test-non-stored-docvalues/1.6 with uniqueid field id
   [junit4]   2> 4783854 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-003/collection1/conf/managed-schema
   [junit4]   2> 4783873 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema, renamed the non-managed schema /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-003/collection1/conf/schema-non-stored-docvalues.xml to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-003/collection1/conf/schema-non-stored-docvalues.xml.bak
   [junit4]   2> 4783877 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=true
   [junit4]   2> 4783945 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4783949 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4783949 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4783976 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 4783984 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test-non-stored-docvalues
   [junit4]   2> 4783995 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test-non-stored-docvalues/1.6 with uniqueid field id
   [junit4]   2> 4783995 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-003/collection1, trusted=true
   [junit4]   2> 4783995 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4783995 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 4783995 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-003/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/init-core-data-001/]
   [junit4]   2> 4784000 WARN  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, registerPath=/solr,/v2, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 4784086 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 4784086 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 4784089 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11235207973829767]
   [junit4]   2> 4784197 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1f10cf91[collection1] main]
   [junit4]   2> 4784204 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-003/collection1/conf
   [junit4]   2> 4784210 INFO  (coreLoadExecutor-9862-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 4784217 INFO  (searcherExecutor-9863-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1f10cf91[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.6.0):C1) Uninverting(_1(6.6.0):C6)))}
   [junit4]   2> 4784237 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 4784238 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-003/collection1/conf/managed-schema
   [junit4]   2> 4784242 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-003/collection1/conf/managed-schema
   [junit4]   2> 4784257 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 4784259 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 2
   [junit4]   2> 4784260 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[myid1]} 0 1
   [junit4]   2> 4784260 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4784261 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@304c7cad
   [junit4]   2> 4784296 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6154e5ff[collection1] main]
   [junit4]   2> 4784296 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4784296 INFO  (searcherExecutor-9863-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6154e5ff[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.6.0):C1)))}
   [junit4]   2> 4784300 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 40
   [junit4]   2> 4784301 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:myid*&fl=*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4784302 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 4784302 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 4784302 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 4784302 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=707714882
   [junit4]   2> 4784303 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 4784303 INFO  (coreCloseExecutor-9867-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6baf17cf
   [junit4]   2> 4784362 INFO  (coreCloseExecutor-9867-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 4784366 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 4784368 INFO  (TEST-TestUseDocValuesAsStored.testManagedSchema-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testManagedSchema
   [junit4]   2> 4784370 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testOnEmptyIndex
   [junit4]   2> 4784377 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 4784403 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 4784414 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema-non-stored-docvalues.xml instead
   [junit4]   2> 4784417 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.IndexSchema [null] Schema name=test-non-stored-docvalues
   [junit4]   2> 4784428 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.IndexSchema Loaded schema test-non-stored-docvalues/1.6 with uniqueid field id
   [junit4]   2> 4784428 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-004/collection1/conf/managed-schema
   [junit4]   2> 4784441 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema, renamed the non-managed schema /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-004/collection1/conf/schema-non-stored-docvalues.xml to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-004/collection1/conf/schema-non-stored-docvalues.xml.bak
   [junit4]   2> 4784445 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=true
   [junit4]   2> 4784518 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4784523 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4784523 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4784545 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 4784553 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test-non-stored-docvalues
   [junit4]   2> 4784586 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test-non-stored-docvalues/1.6 with uniqueid field id
   [junit4]   2> 4784586 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-004/collection1, trusted=true
   [junit4]   2> 4784586 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4784586 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 4784586 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-004/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/init-core-data-001/]
   [junit4]   2> 4784591 WARN  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, registerPath=/solr,/v2, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 4784670 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 4784670 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 4784672 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11235207973829767]
   [junit4]   2> 4784680 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5986b5ce[collection1] main]
   [junit4]   2> 4784681 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-004/collection1/conf
   [junit4]   2> 4784682 INFO  (coreLoadExecutor-9874-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 4784682 INFO  (searcherExecutor-9875-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5986b5ce[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.6.0):C1)))}
   [junit4]   2> 4784684 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 4784684 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 4784685 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 1
   [junit4]   2> 4784685 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4784685 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@77aa5e5d
   [junit4]   2> 4784696 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@199abb32[collection1] main]
   [junit4]   2> 4784697 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4784697 INFO  (searcherExecutor-9875-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@199abb32[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 4784700 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 14
   [junit4]   2> 4784700 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 4784700 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 4784701 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=test_nonstored_dv_str&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 4784701 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*,test_nonstored_dv_str&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 4784702 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[xyz]} 0 0
   [junit4]   2> 4784702 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 4784702 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 4784702 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=test_nonstored_dv_str&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 4784703 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*,test_nonstored_dv_str&wt=xml} hits=0 status=0 QTime=0
   [junit4]   2> 4784703 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4784703 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@77aa5e5d
   [junit4]   2> 4784762 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5af85c48[collection1] main]
   [junit4]   2> 4784762 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4784763 INFO  (searcherExecutor-9875-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5af85c48[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(6.6.0):C1)))}
   [junit4]   2> 4784763 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 60
   [junit4]   2> 4784763 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4784764 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4784764 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=test_nonstored_dv_str&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4784764 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*,test_nonstored_dv_str&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4784765 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[xyz]} 0 0
   [junit4]   2> 4784765 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4784765 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@77aa5e5d
   [junit4]   2> 4784820 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5927185a[collection1] main]
   [junit4]   2> 4784821 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4784821 INFO  (searcherExecutor-9875-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5927185a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.6.0):C1)))}
   [junit4]   2> 4784826 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 61
   [junit4]   2> 4784827 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4784828 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 4784828 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 4784828 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 4784828 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=440827166
   [junit4]   2> 4784829 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 4784829 INFO  (coreCloseExecutor-9879-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1ac5e22f
   [junit4]   2> 4784831 INFO  (coreCloseExecutor-9879-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 4784835 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 4784836 INFO  (TEST-TestUseDocValuesAsStored.testOnEmptyIndex-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testOnEmptyIndex
   [junit4]   2> 4784838 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testRandomSingleAndMultiValued
   [junit4]   2> 4784848 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 4784886 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 4784896 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema-non-stored-docvalues.xml instead
   [junit4]   2> 4784898 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.IndexSchema [null] Schema name=test-non-stored-docvalues
   [junit4]   2> 4784909 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.IndexSchema Loaded schema test-non-stored-docvalues/1.6 with uniqueid field id
   [junit4]   2> 4784910 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-005/collection1/conf/managed-schema
   [junit4]   2> 4784920 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema, renamed the non-managed schema /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-005/collection1/conf/schema-non-stored-docvalues.xml to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-005/collection1/conf/schema-non-stored-docvalues.xml.bak
   [junit4]   2> 4784926 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=true
   [junit4]   2> 4784994 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4784998 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4784998 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4785025 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.6.0
   [junit4]   2> 4785036 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test-non-stored-docvalues
   [junit4]   2> 4785047 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test-non-stored-docvalues/1.6 with uniqueid field id
   [junit4]   2> 4785047 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-005/collection1, trusted=true
   [junit4]   2> 4785047 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@69d780bf
   [junit4]   2> 4785048 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 4785048 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-005/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/init-core-data-001/]
   [junit4]   2> 4785052 WARN  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, registerPath=/solr,/v2, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 4785161 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 4785161 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 4785163 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11235207973829767]
   [junit4]   2> 4785168 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@461f6bd8[collection1] main]
   [junit4]   2> 4785169 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001/tempDir-005/collection1/conf
   [junit4]   2> 4785170 INFO  (coreLoadExecutor-9886-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 4785170 INFO  (searcherExecutor-9887-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@461f6bd8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.6.0):C1)))}
   [junit4]   2> 4785172 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 4785172 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 4785173 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 1
   [junit4]   2> 4785176 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 1
   [junit4]   2> 4785176 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4785176 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@44d43044
   [junit4]   2> 4785210 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@66f36cfc[collection1] main]
   [junit4]   2> 4785211 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4785211 INFO  (searcherExecutor-9887-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@66f36cfc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(6.6.0):C1)))}
   [junit4]   2> 4785213 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 37
   [junit4]   2> 4785214 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&fl=test_ss_dvo&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785220 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&fl=test_ss_dvo,*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785234 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&fl=*dvo&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785258 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&fl=*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785261 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:1&fl=test_ss_dvo,fakeFieldName&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785262 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785266 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[2]} 0 1
   [junit4]   2> 4785269 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4785269 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@44d43044
   [junit4]   2> 4785343 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b5aee3d[collection1] main]
   [junit4]   2> 4785344 INFO  (searcherExecutor-9887-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5b5aee3d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(6.6.0):C1) Uninverting(_6(6.6.0):C1)))}
   [junit4]   2> 4785344 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4785345 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 75
   [junit4]   2> 4785347 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:2&fl=test_i_dvo&wt=xml} hits=1 status=0 QTime=1
   [junit4]   2> 4785348 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:2&fl=test_i_dvo,*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785348 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:2&fl=*dvo&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785349 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:2&fl=*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785349 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:2&fl=test_i_dvo,fakeFieldName&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785350 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*&wt=xml} hits=2 status=0 QTime=0
   [junit4]   2> 4785354 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[3]} 0 1
   [junit4]   2> 4785356 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4785356 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@44d43044
   [junit4]   2> 4785388 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4e0ea72c[collection1] main]
   [junit4]   2> 4785388 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4785388 INFO  (searcherExecutor-9887-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4e0ea72c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(6.6.0):C1) Uninverting(_6(6.6.0):C1) Uninverting(_7(6.6.0):C1)))}
   [junit4]   2> 4785388 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 32
   [junit4]   2> 4785389 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:3&fl=test_ds_dvo&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785390 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:3&fl=test_ds_dvo,*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785391 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:3&fl=*dvo&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785391 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:3&fl=*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785392 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:3&fl=test_ds_dvo,fakeFieldName&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785393 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*&wt=xml} hits=3 status=0 QTime=0
   [junit4]   2> 4785399 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[4]} 0 4
   [junit4]   2> 4785399 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4785399 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@44d43044
   [junit4]   2> 4785461 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@745ea211[collection1] main]
   [junit4]   2> 4785462 INFO  (searcherExecutor-9887-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@745ea211[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(6.6.0):C1) Uninverting(_6(6.6.0):C1) Uninverting(_7(6.6.0):C1) Uninverting(_8(6.6.0):C1)))}
   [junit4]   2> 4785463 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4785463 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 63
   [junit4]   2> 4785464 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:4&fl=test_l_dvo&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785464 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:4&fl=test_l_dvo,*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785465 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:4&fl=*dvo&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785466 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:4&fl=*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785467 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:4&fl=test_l_dvo,fakeFieldName&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785468 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*&wt=xml} hits=4 status=0 QTime=0
   [junit4]   2> 4785470 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[5]} 0 1
   [junit4]   2> 4785470 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4785470 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@44d43044
   [junit4]   2> 4785582 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2a0dfd03[collection1] main]
   [junit4]   2> 4785584 INFO  (searcherExecutor-9887-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2a0dfd03[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(6.6.0):C1) Uninverting(_6(6.6.0):C1) Uninverting(_7(6.6.0):C1) Uninverting(_8(6.6.0):C1) Uninverting(_9(6.6.0):C1)))}
   [junit4]   2> 4785585 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4785585 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 114
   [junit4]   2> 4785591 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:5&fl=test_f_dvo&wt=xml} hits=1 status=0 QTime=5
   [junit4]   2> 4785600 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:5&fl=test_f_dvo,*&wt=xml} hits=1 status=0 QTime=2
   [junit4]   2> 4785601 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:5&fl=*dvo&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785601 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:5&fl=*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785602 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:5&fl=test_f_dvo,fakeFieldName&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785603 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*&wt=xml} hits=5 status=0 QTime=0
   [junit4]   2> 4785606 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[6]} 0 1
   [junit4]   2> 4785607 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4785607 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@44d43044
   [junit4]   2> 4785660 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@26b54e9a[collection1] main]
   [junit4]   2> 4785661 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4785661 INFO  (searcherExecutor-9887-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@26b54e9a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(6.6.0):C1) Uninverting(_6(6.6.0):C1) Uninverting(_7(6.6.0):C1) Uninverting(_8(6.6.0):C1) Uninverting(_9(6.6.0):C1) Uninverting(_a(6.6.0):C1)))}
   [junit4]   2> 4785661 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 54
   [junit4]   2> 4785662 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:6&fl=test_dts_dvo&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785664 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:6&fl=test_dts_dvo,*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785665 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:6&fl=*dvo&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785668 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:6&fl=*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785669 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:6&fl=test_dts_dvo,fakeFieldName&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785670 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*&wt=xml} hits=6 status=0 QTime=0
   [junit4]   2> 4785673 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[7]} 0 1
   [junit4]   2> 4785674 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4785674 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@44d43044
   [junit4]   2> 4785713 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4d887c1e[collection1] main]
   [junit4]   2> 4785714 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4785714 INFO  (searcherExecutor-9887-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4d887c1e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(6.6.0):C1) Uninverting(_6(6.6.0):C1) Uninverting(_7(6.6.0):C1) Uninverting(_8(6.6.0):C1) Uninverting(_9(6.6.0):C1) Uninverting(_a(6.6.0):C1) Uninverting(_b(6.6.0):C1)))}
   [junit4]   2> 4785714 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 40
   [junit4]   2> 4785715 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:7&fl=test_s_dv&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785716 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:7&fl=test_s_dv,*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785716 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:7&fl=*_dv&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785717 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:7&fl=*&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785718 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:7&fl=test_s_dv,fakeFieldName&wt=xml} hits=1 status=0 QTime=0
   [junit4]   2> 4785718 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=*:*&fl=*&wt=xml} hits=7 status=0 QTime=0
   [junit4]   2> 4785720 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[8]} 0 1
   [junit4]   2> 4785721 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 4785721 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@44d43044
   [junit4]   2> 4785772 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@99d6a46[collection1] main]
   [junit4]   2> 4785772 INFO  (TEST-TestUseDocValuesAsStored.testRandomSingleAndMultiValued-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 4785773 INFO  (searcherExecutor-9887-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@99d6a46[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(6.6.0):C1) Uninverting(_6(6.6.0):C1) Uninverting(_7(6.6.0):C1) Uninverting(_8(6.6.0):C1) Uni

[...truncated too long message...]

t4]   2> 4791890 INFO  (TEST-TestUseDocValuesAsStored.testMultivaluedOrdering-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 4791890 INFO  (TEST-TestUseDocValuesAsStored.testMultivaluedOrdering-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}{deleteByQuery=*:*} 0 0
   [junit4]   2> 4791890 INFO  (TEST-TestUseDocValuesAsStored.testMultivaluedOrdering-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 4791890 INFO  (TEST-TestUseDocValuesAsStored.testMultivaluedOrdering-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1217991663
   [junit4]   2> 4791891 INFO  (TEST-TestUseDocValuesAsStored.testMultivaluedOrdering-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 4791891 INFO  (coreCloseExecutor-9903-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@116f33f3
   [junit4]   2> 4791893 INFO  (coreCloseExecutor-9903-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 4791916 INFO  (TEST-TestUseDocValuesAsStored.testMultivaluedOrdering-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 4791918 INFO  (TEST-TestUseDocValuesAsStored.testMultivaluedOrdering-seed#[E7F98B92BAB3A8DE]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMultivaluedOrdering
   [junit4]   2> 4791932 INFO  (SUITE-TestUseDocValuesAsStored-seed#[E7F98B92BAB3A8DE]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestUseDocValuesAsStored_E7F98B92BAB3A8DE-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=371, maxMBSortInHeap=7.9548696279166276, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=uk-UA, timezone=Pacific/Nauru
   [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_121 (64-bit)/cpus=3,threads=1,free=174948768,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestConfigSetsAPIZkFailure, TestDownShardTolerantSearch, DistributedSpellCheckComponentTest, UniqFieldsUpdateProcessorFactoryTest, SegmentsInfoRequestHandlerTest, TestExportWriter, PrimitiveFieldTypeTest, TestBulkSchemaConcurrent, MigrateRouteKeyTest, SmileWriterTest, TestBinaryResponseWriter, XsltUpdateRequestHandlerTest, TestTolerantSearch, TestReRankQParserPlugin, SoftAutoCommitTest, ResponseLogComponentTest, PeerSyncReplicationTest, TestLFUCache, InfixSuggestersTest, TestConfigOverlay, BaseCdcrDistributedZkTest, InfoHandlerTest, ExplicitHLLTest, FileUtilsTest, OverriddenZkACLAndCredentialsProvidersTest, PreAnalyzedFieldManagedSchemaCloudTest, TestScoreJoinQPNoScore, TermsComponentTest, TestUpdate, TestPostingsSolrHighlighter, TestSolrDynamicMBean, AnalysisAfterCoreReloadTest, TestAuthenticationFramework, WrapperMergePolicyFactoryTest, TestFunctionQuery, CurrencyFieldXmlFileTest, BlockJoinFacetSimpleTest, TestSort, TestSolrCloudWithDelegationTokens, TestElisionMultitermQuery, SolrMetricReporterTest, SimplePostToolTest, TimeZoneUtilsTest, TestSolrFieldCacheMBean, TestReplicationHandlerBackup, TemplateUpdateProcessorTest, TestPseudoReturnFields, TestConfigSetProperties, SchemaVersionSpecificBehaviorTest, RequestLoggingTest, OverseerModifyCollectionTest, TestRestManager, TestPhraseSuggestions, SystemInfoHandlerTest, TestStressVersions, TestMiniSolrCloudCluster, TestLRUCache, TestSubQueryTransformerCrossCore, TestCollationField, DirectSolrConnectionTest, TestWordDelimiterFilterFactory, ChaosMonkeyNothingIsSafeTest, BigEndianAscendingWordSerializerTest, TestEmbeddedSolrServerConstructors, PKIAuthenticationIntegrationTest, DeleteReplicaTest, TestSolrQueryParserDefaultOperatorResource, ExitableDirectoryReaderTest, SampleTest, TestRandomFlRTGCloud, TestUnifiedSolrHighlighter, DistributedQueryElevationComponentTest, LeaderFailoverAfterPartitionTest, TestLegacyFieldCache, TestStressUserVersions, RecoveryZkTest, CloneFieldUpdateProcessorFactoryTest, TestConfigReload, QueryElevationComponentTest, TestApiFramework, AssignTest, TestManagedSchemaAPI, DistributedQueueTest, DirectUpdateHandlerTest, RemoteQueryErrorTest, DirectSolrSpellCheckerTest, CdcrReplicationDistributedZkTest, TestHdfsUpdateLog, IndexBasedSpellCheckerTest, TestStressInPlaceUpdates, TestSchemalessBufferedUpdates, TestCloudInspectUtil, CdcrRequestHandlerTest, TestExtendedDismaxParser, NumericFieldsTest, TestSchemaVersionResource, TestShortCircuitedRequests, TestPartialUpdateDeduplication, TestRawTransformer, CollectionStateFormat2Test, ConjunctionSolrSpellCheckerTest, V2ApiIntegrationTest, TestOverriddenPrefixQueryForCustomFieldType, StatelessScriptUpdateProcessorFactoryTest, EnumFieldTest, TestAnalyzeInfixSuggestions, TestSolrCloudSnapshots, HdfsDirectoryTest, TestLocalFSCloudBackupRestore, JSONWriterTest, DocValuesTest, XmlUpdateRequestHandlerTest, TestFieldCacheSort, TestCorePropertiesReload, TestJsonRequest, TestObjectReleaseTracker, TestUseDocValuesAsStored2, RollingRestartTest, TestSolrCLIRunExample, TestMaxScoreQueryParser, TestMinMaxOnMultiValuedField, TestRandomDVFaceting, CdcrUpdateLogTest, TestNRTOpen, PrimUtilsTest, DisMaxRequestHandlerTest, BlockJoinFacetDistribTest, TestLeaderElectionZkExpiry, HdfsChaosMonkeySafeLeaderTest, JSONWriterTest, AnalyticsQueryTest, OverseerStatusTest, TestHdfsCloudBackupRestore, DocumentAnalysisRequestHandlerTest, HardAutoCommitTest, TestFileDictionaryLookup, IgnoreCommitOptimizeUpdateProcessorFactoryTest, SolrGangliaReporterTest, SyncSliceTest, BadComponentTest, PeerSyncWithIndexFingerprintCachingTest, TestFieldCacheVsDocValues, TestManagedSynonymFilterFactory, HdfsRecoveryZkTest, ZkNodePropsTest, LeaderElectionTest, CollectionsAPIAsyncDistributedZkTest, HdfsBasicDistributedZkTest, TestCursorMarkWithoutUniqueKey, ActionThrottleTest, PluginInfoTest, TestNumericTerms64, TestPivotHelperCode, ConcurrentDeleteAndCreateCollectionTest, TestHighlightDedupGrouping, SolrCoreTest, TestSolrConfigHandlerConcurrent, DeleteLastCustomShardedReplicaTest, SolrPluginUtilsTest, TestSolr4Spatial2, PropertiesRequestHandlerTest, TestCustomSort, TestPKIAuthenticationPlugin, JavabinLoaderTest, TestConfigSetsAPI, ShufflingReplicaListTransformerTest, TestManagedResource, PreAnalyzedUpdateProcessorTest, ZkCLITest, BooleanFieldTest, ZkStateWriterTest, RankQueryTest, BasicDistributedZkTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, ShardRoutingCustomTest, TestDistributedSearch, PeerSyncTest, TestBadConfig, HighlighterTest, CurrencyFieldOpenExchangeTest, SuggesterFSTTest, TestFoldingMultitermQuery, SuggesterTest, SpatialFilterTest, PolyFieldTest, SolrCoreCheckLockOnStartupTest, QueryEqualityTest, DefaultValueUpdateProcessorTest, TestRemoteStreaming, TestSolrDeletionPolicy1, CacheHeaderTest, StandardRequestHandlerTest, TestReversedWildcardFilterFactory, TestQueryTypes, FileBasedSpellCheckerTest, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, LoggingHandlerTest, TestJmxIntegration, QueryParsingTest, TestAnalyzedSuggestions, CSVRequestHandlerTest, TestComponentsName, SOLR749Test, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, SolrIndexConfigTest, TestStressRecovery, CloudExitableDirectoryReaderTest, CollectionsAPISolrJTest, DeleteInactiveReplicaTest, DistribCursorPagingTest, DistribJoinFromCollectionTest, DocValuesNotIndexedTest, ForceLeaderTest, LeaderFailureAfterFreshStartTest, LeaderInitiatedRecoveryOnShardRestartTest, MoveReplicaTest, ReplaceNodeTest, SharedFSAutoReplicaFailoverTest, SimpleCollectionCreateDeleteTest, SolrCloudExampleTest, TestCloudPseudoReturnFields, TestCloudRecovery, TestDistribDocBasedVersion, TestMiniSolrCloudClusterSSL, TestRequestForwarding, TestSSLRandomization, TestSizeLimitedDistributedMap, TestStressCloudBlindAtomicUpdates, TestTolerantUpdateProcessorRandomCloud, TlogReplayBufferedWhileIndexingTest, TriLevelCompositeIdRoutingTest, HdfsChaosMonkeyNothingIsSafeTest, HdfsNNFailoverTest, HdfsRecoverLeaseTest, HdfsSyncSliceTest, HdfsThreadLeakTest, HdfsTlogReplayBufferedWhileIndexingTest, HdfsWriteToMultipleCollectionsTest, StressHdfsTest, TestClusterStateMutator, RuleEngineTest, RulesTest, BlobRepositoryCloudTest, TestConfigSets, TestDynamicLoading, TestSQLHandlerNonCloud, TestSolrConfigHandlerCloud, DistributedFacetPivotLongTailTest, DistributedSuggestComponentTest, HighlighterMaxOffsetTest, JvmMetricsTest, SolrCoreMetricManagerTest, SolrMetricsIntegrationTest, SolrGraphiteReporterTest, SolrJmxReporterTest, TestIntervalFaceting, TestMacroExpander, TestBinaryResponseWriter, TestCustomDocTransformer, TestGeoJSONResponseWriter, TestGraphMLResponseWriter, TestPushWriter, TestRawResponseWriter, TestSolrQueryResponse, TestChildDocTransformer, TestSubQueryTransformer, TestSubQueryTransformerDistrib, TestManagedResourceStorage, TestClassNameShortening, TestDefaultSearchFieldResource, TestDynamicFieldResource, TestFieldResource, TestFieldTypeResource, TestSchemaNameResource, TestSchemaResource, TestSchemaSimilarityResource, TestSerializedLuceneMatchVersion, TestUniqueKeyFieldResource, BadCopyFieldTest, ChangedSchemaMergeTest, SpatialRPTFieldTypeTest, TestCollationFieldDocValues, TestPointFields, TestUseDocValuesAsStored]
   [junit4] Completed [632/704 (1!)] on J0 in 10.01s, 6 tests, 1 error <<< FAILURES!

[...truncated 43610 lines...]



---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[JENKINS] Lucene-Solr-6.x-MacOSX () - Build # 828 - Failure!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/828/
Java:

No tests ran.

Build Log:
[...truncated 12 lines...]
ERROR: SEVERE ERROR occurs
org.jenkinsci.lib.envinject.EnvInjectException: Failed to evaluate the script
        at org.jenkinsci.plugins.envinject.service.EnvInjectEnvVars.executeGroovyScript(EnvInjectEnvVars.java:232)
        at org.jenkinsci.plugins.envinject.EnvInjectListener.setUpEnvironmentJobPropertyObject(EnvInjectListener.java:191)
        at org.jenkinsci.plugins.envinject.EnvInjectListener.setUpEnvironment(EnvInjectListener.java:47)
        at hudson.model.AbstractBuild$AbstractBuildExecution.createLauncher(AbstractBuild.java:572)
        at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:492)
        at hudson.model.Run.execute(Run.java:1730)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:405)
Caused by: org.jenkinsci.plugins.scriptsecurity.scripts.UnapprovedUsageException: script not yet approved for use
        at org.jenkinsci.plugins.scriptsecurity.scripts.ScriptApproval.using(ScriptApproval.java:459)
        at org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.SecureGroovyScript.evaluate(SecureGroovyScript.java:170)
        at org.jenkinsci.plugins.envinject.service.EnvInjectEnvVars.executeGroovyScript(EnvInjectEnvVars.java:230)
        ... 8 more
ERROR: Step ‘Archive the artifacts’ failed: no workspace for Lucene-Solr-6.x-MacOSX #828
ERROR: Step ‘Scan for compiler warnings’ failed: no workspace for Lucene-Solr-6.x-MacOSX #828
ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for Lucene-Solr-6.x-MacOSX #828
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[JENKINS] Lucene-Solr-6.x-MacOSX () - Build # 829 - Failure!

Policeman Jenkins Server-2
In reply to this post by Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/829/
Java:

No tests ran.

Build Log:
[...truncated 13 lines...]
ERROR: SEVERE ERROR occurs
org.jenkinsci.lib.envinject.EnvInjectException: Cannot load file null from the master. Loading of files from the master is prohibited globally.
        at org.jenkinsci.plugins.envinject.util.EnvInjectExceptionFormatter.forProhibitedLoadFromMaster(EnvInjectExceptionFormatter.java:19)
        at org.jenkinsci.plugins.envinject.service.EnvInjectEnvVars.getEnvVarsPropertiesJobProperty(EnvInjectEnvVars.java:64)
        at org.jenkinsci.plugins.envinject.EnvInjectListener.setUpEnvironmentJobPropertyObject(EnvInjectListener.java:193)
        at org.jenkinsci.plugins.envinject.EnvInjectListener.setUpEnvironment(EnvInjectListener.java:47)
        at hudson.model.AbstractBuild$AbstractBuildExecution.createLauncher(AbstractBuild.java:572)
        at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:492)
        at hudson.model.Run.execute(Run.java:1730)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:405)
ERROR: Step ‘Archive the artifacts’ failed: no workspace for Lucene-Solr-6.x-MacOSX #829
ERROR: Step ‘Scan for compiler warnings’ failed: no workspace for Lucene-Solr-6.x-MacOSX #829
ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for Lucene-Solr-6.x-MacOSX #829
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Loading...