[JENKINS] Lucene-Solr-7.2-Windows (64bit/jdk1.8.0_144) - Build # 2 - Unstable!

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
17 messages Options
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.2-Windows (64bit/jdk1.8.0_144) - Build # 2 - Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.2-Windows/2/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.lucene.analysis.en.TestKStemmer

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001\tempDir-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001\tempDir-001    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001\tempDir-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001\tempDir-001
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001

        at __randomizedtesting.SeedInfo.seed([BCFFE5726EA4612D]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.V2ApiIntegrationTest

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs\conf1: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs\conf1    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs\conf1: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs\conf1
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001

        at __randomizedtesting.SeedInfo.seed([504F6C38522FA0AB]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.component.DistributedFacetPivotSmallTest

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3\collection1    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3\collection1
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001

        at __randomizedtesting.SeedInfo.seed([504F6C38522FA0AB]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 2725 lines...]
   [junit4] Suite: org.apache.lucene.analysis.en.TestKStemmer
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=6, maxDocsPerChunk=5, blockSize=2), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=6, blockSize=2)), sim=RandomSimilarity(queryNorm=false): {}, locale=lt, timezone=Pacific/Kiritimati
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=50625168,total=97320960
   [junit4]   2> NOTE: All tests run in this JVM: [TestCzechStemmer, TestSegmentingTokenizerBase, TestFrenchLightStemFilterFactory, TestBulgarianAnalyzer, TestTruncateTokenFilter, TestBengaliNormalizer, TestCJKWidthFilterFactory, TestRomanianAnalyzer, TestItalianLightStemFilterFactory, TestIgnore, TestThaiAnalyzer, TestGalicianMinimalStemFilterFactory, TestConcatenatingTokenStream, TestKeywordMarkerFilterFactory, TestFingerprintFilterFactory, TestCapitalizationFilterFactory, TestEnglishMinimalStemFilter, TestArmenianAnalyzer, TestArabicNormalizationFilter, TestTwoSuffixes, TestBulgarianStemmer, CommonGramsFilterTest, TestWikipediaTokenizerFactory, TestTurkishAnalyzer, TestUAX29URLEmailTokenizerFactory, TestSimplePatternTokenizer, ShingleFilterTest, TestItalianLightStemFilter, TestEscaped, TestLatvianAnalyzer, TestSoraniStemFilter, TestDanishAnalyzer, TestCapitalizationFilter, TestUnicodeWhitespaceTokenizer, TestStopFilterFactory, TestPortugueseLightStemFilter, TestGermanLightStemFilterFactory, TestHindiNormalizer, TestBasqueAnalyzer, GreekAnalyzerTest, TestNorwegianMinimalStemFilterFactory, TestGermanNormalizationFilterFactory, QueryAutoStopWordAnalyzerTest, TestPatternReplaceCharFilterFactory, TestFlagNum, TestHomonyms, TestTrimFilter, TestSerbianNormalizationFilterFactory, TestKeywordRepeatFilter, TypeAsPayloadTokenFilterTest, TestCJKBigramFilter, TestLithuanianStemming, TestConv, TestCircumfix, TestOnlyInCompound, TestArabicStemFilter, TestZeroAffix2, DelimitedPayloadTokenFilterTest, TestItalianAnalyzer, TestPatternReplaceFilterFactory, TestPortugueseLightStemFilterFactory, TestBengaliAnalyzer, TestPatternTokenizer, TestCodepointCountFilter, TestSpaces, TestSwedishLightStemFilter, TestPersianAnalyzer, TestSpanishLightStemFilter, TestFactories, TestSynonymGraphFilter, TestRemoveDuplicatesTokenFilter, TestMappingCharFilter, TestCJKAnalyzer, TestUAX29URLEmailTokenizer, TestKStemmer]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestKStemmer -Dtests.seed=BCFFE5726EA4612D -Dtests.slow=true -Dtests.locale=lt -Dtests.timezone=Pacific/Kiritimati -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | TestKStemmer (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001\tempDir-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001\tempDir-001
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.en.TestKStemmer_BCFFE5726EA4612D-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([BCFFE5726EA4612D]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [155/284 (1!)] on J0 in 0.71s, 3 tests, 1 error <<< FAILURES!

[...truncated 9025 lines...]
   [junit4] Suite: org.apache.solr.handler.component.DistributedFacetPivotSmallTest
   [junit4]   2> 353268 INFO  (SUITE-DistributedFacetPivotSmallTest-seed#[504F6C38522FA0AB]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\init-core-data-001
   [junit4]   2> 353270 WARN  (SUITE-DistributedFacetPivotSmallTest-seed#[504F6C38522FA0AB]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3 numCloses=3
   [junit4]   2> 353270 INFO  (SUITE-DistributedFacetPivotSmallTest-seed#[504F6C38522FA0AB]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 353273 INFO  (SUITE-DistributedFacetPivotSmallTest-seed#[504F6C38522FA0AB]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 353273 INFO  (SUITE-DistributedFacetPivotSmallTest-seed#[504F6C38522FA0AB]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /lfu/a
   [junit4]   2> 353732 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\control\cores\collection1
   [junit4]   2> 353734 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 353735 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@58b34b13{/lfu/a,null,AVAILABLE}
   [junit4]   2> 353738 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3741c8c3{HTTP/1.1,[http/1.1]}{127.0.0.1:52073}
   [junit4]   2> 353738 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.Server Started @361790ms
   [junit4]   2> 353738 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/lfu/a, hostPort=52073, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\control\cores}
   [junit4]   2> 353738 ERROR (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 353738 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 353738 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 353738 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 353738 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-06T12:06:07.320Z
   [junit4]   2> 353738 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\control\solr.xml
   [junit4]   2> 353745 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 353745 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 353746 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 353825 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 353831 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 353831 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 353834 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\control\cores
   [junit4]   2> 353834 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 353834 INFO  (coreLoadExecutor-2045-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 353835 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 353890 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 353909 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 353990 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 354001 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 354002 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 354002 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 354002 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\control\cores\collection1\data\]
   [junit4]   2> 354003 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 354081 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 354081 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 354082 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 354082 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 354082 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=43, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 354084 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4ba11779[collection1] main]
   [junit4]   2> 354087 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 354095 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 354137 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 354137 INFO  (coreLoadExecutor-2045-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586036177862918144
   [junit4]   2> 354137 INFO  (searcherExecutor-2046-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 354138 INFO  (searcherExecutor-2046-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 354138 INFO  (searcherExecutor-2046-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 354138 INFO  (searcherExecutor-2046-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 354139 INFO  (searcherExecutor-2046-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 354139 INFO  (searcherExecutor-2046-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 354139 INFO  (searcherExecutor-2046-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 354139 INFO  (searcherExecutor-2046-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 354139 INFO  (searcherExecutor-2046-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 354139 INFO  (searcherExecutor-2046-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4ba11779[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 354745 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard0\cores\collection1
   [junit4]   2> 354747 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 354748 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@29fde512{/lfu/a,null,AVAILABLE}
   [junit4]   2> 354749 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@54c8d18c{HTTP/1.1,[http/1.1]}{127.0.0.1:52081}
   [junit4]   2> 354750 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.Server Started @362802ms
   [junit4]   2> 354750 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/lfu/a, hostPort=52081, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard0\cores}
   [junit4]   2> 354750 ERROR (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 354750 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 354750 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 354750 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 354750 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-06T12:06:08.332Z
   [junit4]   2> 354751 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard0\solr.xml
   [junit4]   2> 354759 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 354759 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 354760 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 354868 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 354880 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 354880 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 354885 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard0\cores
   [junit4]   2> 354885 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 354885 INFO  (coreLoadExecutor-2056-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 354886 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 354979 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 355006 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 355112 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 355123 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 355123 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 355123 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 355123 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard0\cores\collection1\data\]
   [junit4]   2> 355128 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 355248 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 355248 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 355250 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 355250 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 355251 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=43, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 355251 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@28ca75b3[collection1] main]
   [junit4]   2> 355252 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 355263 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 355307 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 355307 INFO  (coreLoadExecutor-2056-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586036179089752064
   [junit4]   2> 355308 INFO  (searcherExecutor-2057-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 355308 INFO  (searcherExecutor-2057-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 355308 INFO  (searcherExecutor-2057-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 355308 INFO  (searcherExecutor-2057-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 355309 INFO  (searcherExecutor-2057-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 355310 INFO  (searcherExecutor-2057-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 355310 INFO  (searcherExecutor-2057-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 355311 INFO  (searcherExecutor-2057-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 355311 INFO  (searcherExecutor-2057-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 355313 INFO  (searcherExecutor-2057-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@28ca75b3[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 355876 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard1\cores\collection1
   [junit4]   2> 355878 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 355878 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d2f9b84{/lfu/a,null,AVAILABLE}
   [junit4]   2> 355879 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@21e16272{HTTP/1.1,[http/1.1]}{127.0.0.1:52086}
   [junit4]   2> 355879 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.Server Started @363932ms
   [junit4]   2> 355879 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/lfu/a, hostPort=52086, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard1\cores}
   [junit4]   2> 355880 ERROR (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 355880 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 355880 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 355880 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 355880 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-06T12:06:09.462Z
   [junit4]   2> 355882 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard1\solr.xml
   [junit4]   2> 355888 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 355888 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 355894 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 356024 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 356035 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 356035 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 356040 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard1\cores
   [junit4]   2> 356040 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 356051 INFO  (coreLoadExecutor-2067-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 356055 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 356113 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 356129 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 356216 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 356226 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 356226 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 356226 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 356227 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard1\cores\collection1\data\]
   [junit4]   2> 356228 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 356308 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 356308 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 356309 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 356309 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 356310 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=43, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 356310 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@618b649f[collection1] main]
   [junit4]   2> 356311 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 356317 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 356344 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 356344 INFO  (searcherExecutor-2068-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 356344 INFO  (coreLoadExecutor-2067-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586036180177125376
   [junit4]   2> 356345 INFO  (searcherExecutor-2068-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 356345 INFO  (searcherExecutor-2068-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 356345 INFO  (searcherExecutor-2068-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 356345 INFO  (searcherExecutor-2068-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 356345 INFO  (searcherExecutor-2068-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 356345 INFO  (searcherExecutor-2068-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 356346 INFO  (searcherExecutor-2068-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 356346 INFO  (searcherExecutor-2068-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 356348 INFO  (searcherExecutor-2068-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@618b649f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 356774 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard2\cores\collection1
   [junit4]   2> 356777 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 356778 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3adbf69b{/lfu/a,null,AVAILABLE}
   [junit4]   2> 356779 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@251a0dea{HTTP/1.1,[http/1.1]}{127.0.0.1:52097}
   [junit4]   2> 356779 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.Server Started @364831ms
   [junit4]   2> 356779 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/lfu/a, hostPort=52097, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard2\cores}
   [junit4]   2> 356781 ERROR (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 356781 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 356781 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 356781 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 356781 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-06T12:06:10.363Z
   [junit4]   2> 356782 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard2\solr.xml
   [junit4]   2> 356800 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 356800 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 356801 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 356872 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 356888 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 356888 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 356891 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard2\cores
   [junit4]   2> 356892 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 356892 INFO  (coreLoadExecutor-2078-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 356892 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 356955 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 356973 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 357065 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 357076 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 357077 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 357077 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 357077 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard2\cores\collection1\data\]
   [junit4]   2> 357078 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 357174 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 357174 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 357175 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 357175 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 357177 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=43, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 357179 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@52e00eab[collection1] main]
   [junit4]   2> 357179 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 357187 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 357221 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 357221 INFO  (searcherExecutor-2079-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 357221 INFO  (coreLoadExecutor-2078-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586036181096726528
   [junit4]   2> 357221 INFO  (searcherExecutor-2079-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 357222 INFO  (searcherExecutor-2079-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 357222 INFO  (searcherExecutor-2079-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 357222 INFO  (searcherExecutor-2079-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 357222 INFO  (searcherExecutor-2079-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 357222 INFO  (searcherExecutor-2079-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 357223 INFO  (searcherExecutor-2079-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 357223 INFO  (searcherExecutor-2079-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 357225 INFO  (searcherExecutor-2079-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@52e00eab[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 357646 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3\cores\collection1
   [junit4]   2> 357648 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 357649 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@8278888{/lfu/a,null,AVAILABLE}
   [junit4]   2> 357650 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@52f0d01c{HTTP/1.1,[http/1.1]}{127.0.0.1:52100}
   [junit4]   2> 357650 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.e.j.s.Server Started @365703ms
   [junit4]   2> 357650 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/lfu/a, hostPort=52100, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3\cores}
   [junit4]   2> 357650 ERROR (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 357650 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 357650 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 357650 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 357651 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-06T12:06:11.232Z
   [junit4]   2> 357651 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3\solr.xml
   [junit4]   2> 357658 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 357658 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 357659 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 357730 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 357736 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 357736 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 357738 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3\cores
   [junit4]   2> 357738 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 357739 INFO  (coreLoadExecutor-2089-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 357740 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 357799 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 357816 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 357903 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 357913 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 357914 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23bbec2c
   [junit4]   2> 357914 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 357914 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_504F6C38522FA0AB-001\tempDir-001\shard3\cores\collection1\data\]
   [junit4]   2> 357918 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 358025 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 358025 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 358026 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 358026 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 358028 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=43, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 358028 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@77e060d1[collection1] main]
   [junit4]   2> 358028 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 358039 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 358090 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 358091 INFO  (searcherExecutor-2090-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 358091 INFO  (coreLoadExecutor-2089-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586036182008987648
   [junit4]   2> 358091 INFO  (searcherExecutor-2090-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 358091 INFO  (searcherExecutor-2090-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 358093 INFO  (searcherExecutor-2090-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 358095 INFO  (searcherExecutor-2090-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 358097 INFO  (searcherExecutor-2090-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 358098 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[504F6C38522FA0AB]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 358101 INFO  (searcherExecutor-2090-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 358103 INFO  (searcherExecutor-2090-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 358104 INFO  (searcherExecutor-2090-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 358108 INFO  (searcherExecutor-2090-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@77e060d1[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 358113 INFO  (qtp78080321-3253) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1586036182019473408)} 0 11
   [junit4]   2> 358121 INFO  (qtp143287756-3269) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1586036182035202048)} 0 4
   [junit4]   2> 358128 INFO  (qtp204054744-3294) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1586036182043590656)} 0 3
   [junit4]   2> 358134 INFO  (qtp917252056-3314) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1586036182050930688)} 0 4
   [junit4]   2> 358142 INFO  (qtp1344150869-3327) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1586036182056173568)} 0 3
   [junit4]   2> 358150 INFO  (qtp78080321-3254) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[19 (1586036182063513600)]} 0 7
   [junit4]   2> 358155 INFO  (qtp917252056-3312) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[19 (1586036182071902208)]} 0 3
   [junit4]   2> 358160 INFO  (qtp78080321-3256) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[20 (1586036182077145088)]} 0 4
   [junit4]   2> 358171 INFO  (qtp143287756-3272) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[20 (1586036182082387968)]} 0 10
   [junit4]   2> 358176 INFO  (qtp78080321-3255) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[21 (1586036182093922304)]} 0 2
   [junit4]   2> 358187 INFO  (qtp204054744-3292) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[21 (1586036182098116608)]} 0 10
   [junit4]   2> 358188 INFO  (qtp78080321-3255) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[22 (1586036182110699520)]} 0 0
   [junit4]   2> 358245 INFO  (qtp917252056-3310) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[22 (1586036182110699520)]} 0 57
   [junit4]   2> 358248 INFO  (qtp78080321-3258) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[23 (1586036182171516928)]} 0 0
   [junit4]   2> 358251 INFO  (qtp1344150869-3328) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[23 (1586036182173614080)]} 0 4
   [junit4]   2> 358254 INFO  (qtp78080321-3258) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[24 (1586036182177808384)]} 0 0
   [junit4]   2> 358259 INFO  (qtp143287756-3270) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[24 (1586036182184099840)]} 0 1
   [junit4]   2> 358263 INFO  (qtp78080321-3253) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[25 (1586036182186196992)]} 0 1
   [junit4]   2> 358266 INFO  (qtp204054744-3291) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[25 (1586036182189342720)]} 0 2
   [junit4]   2> 358266 INFO  (qtp78080321-3253) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[26 (1586036182192488448)]} 0 0
   [junit4]   2> 358266 INFO  (qtp917252056-3309) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[26 (1586036182192488448)]} 0 0
   [junit4]   2> 358268 INFO  (qtp78080321-3253) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[27 (1586036182194585600)]} 0 0
   [junit4]   2> 358269 INFO  (qtp1344150869-3329) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[27 (1586036182194585600)]} 0 1
   [junit4]   2> 358269 INFO  (qtp78080321-3253) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[28 (1586036182195634176)]} 0 0
   [junit4]   2> 358272 INFO  (qtp143287756-3275) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={wt=javabin&version=2}{add=[28 (1586036182198779904)]} 0 0
   [junit4]   2> 358272 INFO  (qtp78080321-3253) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1586036182198779904,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 358272 INFO  (qtp78080321-3253) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@17767f1b commitCommandVersion:1586036182198779904
   [junit4]   2> 358310 INFO  (qtp78080321-3253) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@708588e0[collection1] main]
   [junit4]   2> 358311 INFO  (qtp78080321-3253) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 358313 INFO  (searcherExecutor-2046-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@708588e0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.2.0):C10)))}
   [junit4]   2> 358313 INFO  (qtp78080321-3253) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 40
   [junit4]   2> 358314 INFO  (qtp143287756-3275) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1586036182242820096,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 358314 INFO  (qtp143287756-3275) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@26ea65a7 commitCommandVersion:1586036182242820096
   [junit4]   2> 358320 INFO  (qtp143287756-3275) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@9d8844a[collection1] main]
   [junit4]   2> 358321 INFO  (qtp143287756-3275) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 358323 INFO  (searcherExecutor-2057-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@9d8844a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.2.0):C3)))}
   [junit4]   2> 358323 INFO  (qtp143287756-3275) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 8
   [junit4]   2> 358324 INFO  (qtp204054744-3290) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1586036182253305856,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 358324 INFO  (qtp204054744-3290) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@51a0fda9 commitCommandVersion:1586036182253305856
   [junit4]   2> 358330 INFO  (qtp204054744-3290) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@567d2d4a[collection1] main]
   [junit4]   2> 358330 INFO  (qtp204054744-3290) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 358339 INFO  (searcherExecutor-2068-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@567d2d4a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.2.0):C2)))}
   [junit4]   2> 358339 INFO  (qtp204054744-3290) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 15
   [junit4]   2> 358339 INFO  (qtp917252056-3309) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1586036182269034496,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 358340 INFO  (qtp917252056-3309) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@2f81afd1 commitCommandVersion:1586036182269034496
   [junit4]   2> 358359 INFO  (qtp917252056-3309) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b3b643f[collection1] main]
   [junit4]   2> 358360 INFO  (qtp917252056-3309) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 358361 INFO  (searcherExecutor-2079-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2b3b643f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.2.0):C3)))}
   [junit4]   2> 358361 INFO  (qtp917252056-3309) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 20
   [junit4]   2> 358362 INFO  (qtp1344150869-3329) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1586036182293151744,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 358362 INFO  (qtp1344150869-3329) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@209245 commitCommandVersion:1586036182293151744
   [junit4]   2> 358370 INFO  (qtp1344150869-3329) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7fcd9e13[collection1] main]
   [junit4]   2> 358371 INFO  (qtp1344150869-3329) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 358372 INFO  (searcherExecutor-2090-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7fcd9e13[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.2.0):C2)))}
   [junit4]   2> 358372 INFO  (qtp1344150869-3329) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/lfu/a path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 10
   [junit4]   2> 358379 INFO  (qtp204054744-3289) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/lfu/a path=/select params={df=text&distrib=false&facet.pivot=place_t,company_t&fl=id&fl=score&f.place_t.facet.pivot.mincount=0&shards.purpose=20&start=0&fsv=true&f.company_t.facet.limit=160&f.place_t.facet.limit=160&shard.url=http://127.0.0.1:52086/lfu/a/collection1&rows=10&version=2&q=*:*&f.company_t.facet.pivot.mincount=0&NOW=1512561971954&isShard=true&facet=true&wt=javabin} hits=2 status=0 QTime=1
   [junit4]   2> 358379 INFO  (qtp1344150869-3331) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/lfu/a path=/select params={df=text&distrib=false&facet.pivot=place_t,company_t&fl=id&fl=score&f.place_t.facet.pivot.mincount=0&shards.purpose=20&start=0&fsv=true&f.company_t.facet.limit=160&f.place_t.facet.limit=160&shard.url=http://127.0.0.1:52100/lfu/a/collection1&rows=10&version=2&q=*:*&f.company_t.facet.pivot.mincount=0&NOW=1512561971954&isShard=true&facet=true&wt=javabin} hits=2 status=0 QTime=3
   [junit4]   2> 358383 INFO  (qtp917252056-3307) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/lfu/a path=/select params={df=text&distrib=false&facet.pivot=place_t,company_t&fl=id&fl=score&f.place_t.facet.pivot.mincount=0&shards.purpose=20&start=0&fsv=true&f.company_t.facet.limit=160&f.place_t.facet.limit=160&shard.url=http://127.0.0.1:52097/lfu/a/collection1&rows=10&version=2&q=*:*&f.company_t.facet.pivot.mincount=0&NOW=1512561971954&isShard=true&facet=true&wt=javabin} hits=3 status=0 QTime=1
   [junit4]   2> 358384 INFO  (qtp143287756-3273) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/lfu/a path=/select params={df=text&distrib=false&facet.pivot=place_t,company_t&fl=id&fl=score&f.place_t.facet.pivot.mincount=0&shards.purpose=20&start=0&fsv=true&f.company_t.facet.limit=160&f.place_t.facet.limit=160&shard.url=http://127.0.0.1:52081/lfu/a/collection1&rows=10&version=2&q=*:*&f.company_t.facet.pivot.mincount=0&NOW=1512561971954&isShard=true&facet=true&wt=javabin} hits=3 status=0 QTime=1
   [junit4]   2> 358388 INFO  (qtp917252056-3307) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/lfu/a path=/select params={q=*:*&df=text&distrib=false&facet.pivot=place_t,company_t&shards.purpose=64&NOW=1512561971954&ids=22,26,19&isShard=true&shard.url=http://127.0.0.1:52097/lfu/a/collection1&facet=false&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 358389 INFO  (qtp1344150869-3331) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/lfu/a path=/select params={q=*:*&df=text&distrib=false&facet.pivot=place_t,company_t&shards.purpose=64&NOW=1512561971954&ids=23,27&isShard=true&shard.url=http://127.0.0.1:52100/lfu/a/collection1&facet=false&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 358390 INFO  (qtp143287756-3273) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/lfu/a path=/select params={q=*:*&df=text&distrib=false&facet.pivot=place_t,company_t&shards.purpose=64&NOW=1512561971954&ids=24,28,20&isShard=true&shard.url=http://127.0.0.1:52081/lfu/a/collection1&facet=false&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 358390 INFO  (qtp204054744-3289) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/lfu/a path=/select params={q=*:*&df=text&distrib=false&facet.pivot=place_t,company_t&shards.purpose=64&NOW=1512561971954&ids=25,21&isShard=true&shard.url=http://127.0.0.1:52086/lfu/a/collection1&facet=false&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 358391 INFO  (qtp917252056-3308) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/lfu/a path=/select params={shards=http://127.0.0.1:52081/lfu/a/collection1,http://127.0.0.1:52086/lfu/a/collection1,http://127.0.0.1:52097/lfu/a/collection1,http://127.0.0.1:52100/lfu/a/collection1&q=*:*&facet.pivot=place_t,company_t&facet=true&wt=javabin&version=2} hits=10 status=0 QTime=19
   [junit4]   2> 358401 INFO  (qtp143287756-3273) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/lfu/a path=/select params={df=text&distrib=false&facet.pivot=place_t,company_t&fl=id&fl=score&f.place_t.facet.pivot.mincount=0&shards.purpose=20&start=0&fsv=true&f.company_t.facet.limit=160&f.place_t.facet.limit=160&shard.url=http://127.0.0.1:52081/lfu/a/collection1&rows=10&version=2&q=*:*&f.company_t.facet.pivot.mincount=0&NOW=1512561971981&isShard=true&facet=true&wt=javabin&facet.sort=count} hits=3 status=0 QTime=0
   [junit4]   2> 358409 INFO  (qtp1344150869-3331) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/lfu/a path=/select params={df=text&distrib=false&facet.pivot=place_t,company_t&fl=id&fl=score&f.place_t.facet.pivot.mincount=0&shards.purpose=20&start=0&fsv=true&f.company_t.facet.limit=160&f.place_t.facet.limit=160&shard.url=http://127.0.0.1:52100/lfu/a/collection1&rows=10&version=2&q=*:*&f.company_t.facet.pivot.mincount=0&NOW=1512561971981&isShard=true&facet=true&wt=javabin&facet.sort=count} hits=2 s

[...truncated too long message...]

2850-thread-1) [n:127.0.0.1:53175_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n1, tag=316305086
   [junit4]   2> 545963 INFO  (coreCloseExecutor-2850-thread-1) [n:127.0.0.1:53175_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@374c1981: rootName = solr_53175, domain = solr.core.collection1.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@10c8233f
   [junit4]   2> 545973 INFO  (coreCloseExecutor-2850-thread-1) [n:127.0.0.1:53175_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=316305086
   [junit4]   2> 545973 INFO  (coreCloseExecutor-2851-thread-1) [n:127.0.0.1:53172_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore [collection1_shard1_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@4877c673
   [junit4]   2> 545977 INFO  (coreCloseExecutor-2851-thread-1) [n:127.0.0.1:53172_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n2, tag=1215809139
   [junit4]   2> 545977 INFO  (coreCloseExecutor-2851-thread-1) [n:127.0.0.1:53172_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@52afde9: rootName = solr_53172, domain = solr.core.collection1.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.collection1.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@3d5c0008
   [junit4]   2> 545994 INFO  (coreCloseExecutor-2851-thread-1) [n:127.0.0.1:53172_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=1215809139
   [junit4]   2> 546017 INFO  (jetty-closer-1085-thread-2) [    ] o.a.s.c.Overseer Overseer (id=99127273405284357-127.0.0.1:53175_solr-n_0000000000) closing
   [junit4]   2> 546018 INFO  (OverseerStateUpdate-99127273405284357-127.0.0.1:53175_solr-n_0000000000) [n:127.0.0.1:53175_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:53175_solr
   [junit4]   2> 546022 WARN  (OverseerAutoScalingTriggerThread-99127273405284357-127.0.0.1:53175_solr-n_0000000000) [n:127.0.0.1:53175_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 546022 INFO  (jetty-closer-1085-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@26ffb4d0{/solr,null,UNAVAILABLE}
   [junit4]   2> 546027 INFO  (jetty-closer-1085-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@48a5c94d{/solr,null,UNAVAILABLE}
   [junit4]   2> 546029 ERROR (SUITE-V2ApiIntegrationTest-seed#[504F6C38522FA0AB]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 546029 INFO  (SUITE-V2ApiIntegrationTest-seed#[504F6C38522FA0AB]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53168 53168
   [junit4]   2> 546032 INFO  (Thread-1057) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53168 53168
   [junit4]   2> 546034 WARN  (Thread-1057) [    ] o.a.s.c.ZkTestServer Watch limit violations:
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2>
   [junit4]   2> 3 /solr/aliases.json
   [junit4]   2> 3 /solr/clusterprops.json
   [junit4]   2> 2 /solr/configs/conf1/managed-schema
   [junit4]   2> 2 /solr/security.json
   [junit4]   2> 2 /solr/configs/conf1
   [junit4]   2>
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2>
   [junit4]   2> 14 /solr/collections/collection1/state.json
   [junit4]   2> 3 /solr/clusterstate.json
   [junit4]   2> 3 /solr/clusterprops.json
   [junit4]   2>
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2>
   [junit4]   2> 3 /solr/live_nodes
   [junit4]   2> 3 /solr/collections
   [junit4]   2>
   [junit4]   2> 546035 INFO  (SUITE-V2ApiIntegrationTest-seed#[504F6C38522FA0AB]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Dec 06, 2017 12:09:19 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 4 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=804, maxMBSortInHeap=7.063193237412964, sim=RandomSimilarity(queryNorm=true): {}, locale=sr-Latn-RS, timezone=America/Yakutat
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=85166160,total=227872768
   [junit4]   2> NOTE: All tests run in this JVM: [JsonLoaderTest, TestPolicyCloud, SpellingQueryConverterTest, TestMaxScoreQueryParser, CollectionsAPIDistributedZkTest, BigEndianAscendingWordDeserializerTest, PreAnalyzedFieldManagedSchemaCloudTest, TestClusterProperties, TestManagedSchema, TestInfoStreamLogging, TestLuceneIndexBackCompat, TestLeaderInitiatedRecoveryThread, TestSolrCloudWithHadoopAuthPlugin, SolrIndexMetricsTest, DocValuesMultiTest, TemplateUpdateProcessorTest, SSLMigrationTest, RecoveryAfterSoftCommitTest, TestCloudPivotFacet, WrapperMergePolicyFactoryTest, SampleTest, SolrPluginUtilsTest, HdfsBasicDistributedZkTest, CdcrReplicationHandlerTest, SolrCoreTest, TermsComponentTest, TestSolrConfigHandler, TestHashPartitioner, TestReloadDeadlock, QueryResultKeyTest, ShufflingReplicaListTransformerTest, ConnectionManagerTest, SimpleFacetsTest, DocValuesTest, TestRebalanceLeaders, TestCorePropertiesReload, DistributedFacetPivotSmallTest, MissingSegmentRecoveryTest, TestCloudInspectUtil, TestLRUStatsCache, TestBM25SimilarityFactory, TestMacros, CoreAdminHandlerTest, TestBlobHandler, DocumentBuilderTest, DeleteLastCustomShardedReplicaTest, TestValueSourceCache, PreAnalyzedUpdateProcessorTest, TestTolerantUpdateProcessorCloud, DocumentAnalysisRequestHandlerTest, SolrCoreCheckLockOnStartupTest, SolrIndexConfigTest, TestLeaderElectionWithEmptyReplica, MoreLikeThisHandlerTest, TestSolrCloudWithKerberosAlt, TestInitQParser, ChaosMonkeySafeLeaderTest, TestLuceneMatchVersion, V2ApiIntegrationTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=V2ApiIntegrationTest -Dtests.seed=504F6C38522FA0AB -Dtests.slow=true -Dtests.locale=sr-Latn-RS -Dtests.timezone=America/Yakutat -Dtests.asserts=true -Dtests.file.encoding=Cp1252
   [junit4] ERROR   0.00s J1 | V2ApiIntegrationTest (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs\conf1: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001\tempDir-002\backup_test\zk_backup\configs\conf1
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.V2ApiIntegrationTest_504F6C38522FA0AB-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([504F6C38522FA0AB]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [81/751 (2!)] on J1 in 4.94s, 6 tests, 1 error <<< FAILURES!

[...truncated 49679 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.2-Windows (64bit/jdk-9.0.1) - Build # 3 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.2-Windows/3/
Java: 64bit/jdk-9.0.1 -XX:-UseCompressedOops -XX:+UseSerialGC

7 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.lucene.index.TestBackwardsCompatibility

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_67459F905E2F12AD-001\4.8.1-cfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_67459F905E2F12AD-001\4.8.1-cfs-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_67459F905E2F12AD-001\4.8.1-cfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_67459F905E2F12AD-001\4.8.1-cfs-001

        at __randomizedtesting.SeedInfo.seed([67459F905E2F12AD]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.lucene.replicator.IndexReplicationClientTest.testNoUpdateThread

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\replicator\test\J1\temp\lucene.replicator.IndexReplicationClientTest_3AC093E90D8E2816-001\replicationClientTest-004\1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\replicator\test\J1\temp\lucene.replicator.IndexReplicationClientTest_3AC093E90D8E2816-001\replicationClientTest-004\1

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\replicator\test\J1\temp\lucene.replicator.IndexReplicationClientTest_3AC093E90D8E2816-001\replicationClientTest-004\1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\replicator\test\J1\temp\lucene.replicator.IndexReplicationClientTest_3AC093E90D8E2816-001\replicationClientTest-004\1

        at __randomizedtesting.SeedInfo.seed([3AC093E90D8E2816:5FD950842E0E71D0]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.replicator.PerSessionDirectoryFactory.cleanupSession(PerSessionDirectoryFactory.java:58)
        at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:259)
        at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:401)
        at org.apache.lucene.replicator.IndexReplicationClientTest.testNoUpdateThread(IndexReplicationClientTest.java:163)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest

Error Message:
Error from server at http://127.0.0.1:56434/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:56434/solr: create the collection time out:180s
        at __randomizedtesting.SeedInfo.seed([4ECE90731AC75B2D]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
        at org.apache.solr.analytics.legacy.LegacyAbstractAnalyticsCloudTest.setupCollection(LegacyAbstractAnalyticsCloudTest.java:50)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.response.JSONWriterTest

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2\write.lock: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2\write.lock    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2\write.lock: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2\write.lock
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001

        at __randomizedtesting.SeedInfo.seed([ECF7D375836B20F6]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.SpellPossibilityIteratorTest

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001\init-core-data-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001\init-core-data-001    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001\init-core-data-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001\init-core-data-001
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001

        at __randomizedtesting.SeedInfo.seed([ECF7D375836B20F6]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.update.processor.DocExpirationUpdateProcessorFactoryTest

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001\tlog: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001\tlog    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001\tlog: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001\tlog
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001

        at __randomizedtesting.SeedInfo.seed([ECF7D375836B20F6]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.common.cloud.TestZkConfigManager

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2\log.1: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2\log.1    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2\log.1: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2\log.1
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001

        at __randomizedtesting.SeedInfo.seed([6BEC05F531C5AA31]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 4613 lines...]
   [junit4] Suite: org.apache.lucene.index.TestBackwardsCompatibility
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateIndexWithDocValuesUpdates
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateSingleSegmentCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateNoCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateMoreTermsIndex
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateSingleSegmentNoCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateEmptyIndex
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateSortedIndex
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {content6=PostingsFormat(name=Memory), content5=PostingsFormat(name=Memory), content4=FST50, trieInt=PostingsFormat(name=Memory), content3=Lucene50(blocksize=128), content2=PostingsFormat(name=Memory), fie?ld=PostingsFormat(name=Memory), utf8=FST50, trieLong=Lucene50(blocksize=128), id=PostingsFormat(name=Memory), content=FST50, autf8=Lucene50(blocksize=128)}, docValues:{dvShort=DocValuesFormat(name=Asserting), utf8=DocValuesFormat(name=Memory), fie?ld=DocValuesFormat(name=Lucene70), dvInt=DocValuesFormat(name=Memory), longPoint2d=DocValuesFormat(name=Asserting), dvBytesSortedVar=DocValuesFormat(name=Lucene70), dvSortedSet=DocValuesFormat(name=Lucene70), content=DocValuesFormat(name=Memory), floatPoint1d=DocValuesFormat(name=Lucene70), intPoint1d=DocValuesFormat(name=Direct), doublePoint2d=DocValuesFormat(name=Lucene70), trieLong=DocValuesFormat(name=Asserting), dvBytesDerefVar=DocValuesFormat(name=Asserting), id=DocValuesFormat(name=Lucene70), binaryPoint2d=DocValuesFormat(name=Memory), dvSortedNumeric=DocValuesFormat(name=Asserting), dvBytesDerefFixed=DocValuesFormat(name=Memory), autf8=DocValuesFormat(name=Asserting), dvBytesSortedFixed=DocValuesFormat(name=Asserting), dvBytesStraightVar=DocValuesFormat(name=Direct), trieInt=DocValuesFormat(name=Lucene70), dvBytesStraightFixed=DocValuesFormat(name=Lucene70), dvLong=DocValuesFormat(name=Asserting), longPoint1d=DocValuesFormat(name=Memory), floatPoint2d=DocValuesFormat(name=Asserting), dvDouble=DocValuesFormat(name=Lucene70), dvFloat=DocValuesFormat(name=Asserting), content6=DocValuesFormat(name=Lucene70), content5=DocValuesFormat(name=Direct), dvPacked=DocValuesFormat(name=Asserting), intPoint2d=DocValuesFormat(name=Lucene70), content4=DocValuesFormat(name=Memory), content3=DocValuesFormat(name=Asserting), content2=DocValuesFormat(name=Lucene70), doublePoint1d=DocValuesFormat(name=Asserting), dvByte=DocValuesFormat(name=Asserting), binaryPoint1d=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=694, maxMBSortInHeap=5.8693144321114925, sim=RandomSimilarity(queryNorm=true): {content6=DFR I(ne)B2, content5=IB LL-L2, content2=DFR I(n)L1, utf8=LM Jelinek-Mercer(0.700000), fie?ld=IB SPL-LZ(0.3), content=DFR G1, autf8=DFR I(n)L2}, locale=hu-HU, timezone=Europe/Bratislava
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=65346632,total=97386496
   [junit4]   2> NOTE: All tests run in this JVM: [TestFixBrokenOffsets, TestLucene54DocValuesFormat, TestBackwardsCompatibility]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestBackwardsCompatibility -Dtests.seed=67459F905E2F12AD -Dtests.slow=true -Dtests.locale=hu-HU -Dtests.timezone=Europe/Bratislava -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | TestBackwardsCompatibility (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_67459F905E2F12AD-001\4.8.1-cfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_67459F905E2F12AD-001\4.8.1-cfs-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([67459F905E2F12AD]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [8/8 (1!)] on J0 in 16.80s, 30 tests, 1 error, 8 skipped <<< FAILURES!

[...truncated 4101 lines...]
   [junit4] Suite: org.apache.lucene.replicator.IndexReplicationClientTest
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=IndexReplicationClientTest -Dtests.method=testNoUpdateThread -Dtests.seed=3AC093E90D8E2816 -Dtests.slow=true -Dtests.locale=es-CO -Dtests.timezone=Asia/Istanbul -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.08s J1 | IndexReplicationClientTest.testNoUpdateThread <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\replicator\test\J1\temp\lucene.replicator.IndexReplicationClientTest_3AC093E90D8E2816-001\replicationClientTest-004\1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\replicator\test\J1\temp\lucene.replicator.IndexReplicationClientTest_3AC093E90D8E2816-001\replicationClientTest-004\1
   [junit4]    > at __randomizedtesting.SeedInfo.seed([3AC093E90D8E2816:5FD950842E0E71D0]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at org.apache.lucene.replicator.PerSessionDirectoryFactory.cleanupSession(PerSessionDirectoryFactory.java:58)
   [junit4]    > at org.apache.lucene.replicator.ReplicationClient.doUpdate(ReplicationClient.java:259)
   [junit4]    > at org.apache.lucene.replicator.ReplicationClient.updateNow(ReplicationClient.java:401)
   [junit4]    > at org.apache.lucene.replicator.IndexReplicationClientTest.testNoUpdateThread(IndexReplicationClientTest.java:163)
   [junit4]    > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: leaving temporary files on disk at: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\replicator\test\J1\temp\lucene.replicator.IndexReplicationClientTest_3AC093E90D8E2816-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false): {}, locale=es-CO, timezone=Asia/Istanbul
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=68128800,total=97320960
   [junit4]   2> NOTE: All tests run in this JVM: [IndexAndTaxonomyRevisionTest, SessionTokenTest, IndexReplicationClientTest]
   [junit4] Completed [4/9 (1!)] on J1 in 3.87s, 4 tests, 1 error <<< FAILURES!

[...truncated 2843 lines...]
   [junit4] Suite: org.apache.solr.spelling.SpellPossibilityIteratorTest
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001\init-core-data-001
   [junit4]   2> 0    INFO  (SUITE-SpellPossibilityIteratorTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 36   INFO  (SUITE-SpellPossibilityIteratorTest-seed#[ECF7D375836B20F6]-worker) [    ] o.e.j.u.log Logging initialized @10181ms
   [junit4]   2> 42   INFO  (SUITE-SpellPossibilityIteratorTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 50   INFO  (SUITE-SpellPossibilityIteratorTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 58   INFO  (TEST-SpellPossibilityIteratorTest.testOverlappingTokens-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testOverlappingTokens
   [junit4]   2> 127  INFO  (TEST-SpellPossibilityIteratorTest.testOverlappingTokens-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testOverlappingTokens
   [junit4]   2> 146  INFO  (TEST-SpellPossibilityIteratorTest.testSpellPossibilityIterator-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSpellPossibilityIterator
   [junit4]   2> 147  INFO  (TEST-SpellPossibilityIteratorTest.testSpellPossibilityIterator-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testSpellPossibilityIterator
   [junit4]   2> 163  INFO  (TEST-SpellPossibilityIteratorTest.testScalability-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testScalability
   [junit4]   2> 184  INFO  (TEST-SpellPossibilityIteratorTest.testScalability-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testScalability
   [junit4]   2> 186  INFO  (SUITE-SpellPossibilityIteratorTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1050, maxMBSortInHeap=5.47356544717924, sim=RandomSimilarity(queryNorm=true): {}, locale=sw-UG, timezone=Europe/Chisinau
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=62353112,total=97320960
   [junit4]   2> NOTE: All tests run in this JVM: [SpellPossibilityIteratorTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SpellPossibilityIteratorTest -Dtests.seed=ECF7D375836B20F6 -Dtests.slow=true -Dtests.locale=sw-UG -Dtests.timezone=Europe/Chisinau -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | SpellPossibilityIteratorTest (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001\init-core-data-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001\init-core-data-001
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.spelling.SpellPossibilityIteratorTest_ECF7D375836B20F6-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([ECF7D375836B20F6]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [1/751 (1!)] on J1 in 9.20s, 3 tests, 1 error <<< FAILURES!

[...truncated 196 lines...]
   [junit4] Suite: org.apache.solr.update.processor.DocExpirationUpdateProcessorFactoryTest
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001
   [junit4]   2> 197138 WARN  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=33 numCloses=33
   [junit4]   2> 197138 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 197140 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 197140 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 197140 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 197141 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 197160 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1976286871
   [junit4]   2> 197160 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=920949600
   [junit4]   2> 197160 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1158395393
   [junit4]   2> 197166 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 197173 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 197237 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 197290 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6ea0e2f3
   [junit4]   2> 197294 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6ea0e2f3
   [junit4]   2> 197294 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6ea0e2f3
   [junit4]   2> 197296 INFO  (coreLoadExecutor-1075-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 197297 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 197315 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 197321 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 197387 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 197396 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 197397 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6ea0e2f3
   [junit4]   2> 197397 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 197397 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001\]
   [junit4]   2> 197398 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=31, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 197460 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 197460 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 197462 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 197462 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 197463 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=14.6533203125, floorSegmentMB=0.6865234375, forceMergeDeletesPctAllowed=12.101987226573033, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6764358460359605
   [junit4]   2> 197463 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@585e1fe4[collection1] main]
   [junit4]   2> 197463 WARN  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf; switching to use InMemory storage instead.
   [junit4]   2> 197468 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 197468 INFO  (coreLoadExecutor-1075-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586052305285808128
   [junit4]   2> 197468 INFO  (searcherExecutor-1076-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@585e1fe4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 197471 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 197473 INFO  (TEST-DocExpirationUpdateProcessorFactoryTest.testTTLParamConversion-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTTLParamConversion
   [junit4]   2> 197475 INFO  (TEST-DocExpirationUpdateProcessorFactoryTest.testTTLParamConversion-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTTLParamConversion
   [junit4]   2> 197477 INFO  (TEST-DocExpirationUpdateProcessorFactoryTest.testTTLDefaultsConversion-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTTLDefaultsConversion
   [junit4]   2> 197477 INFO  (TEST-DocExpirationUpdateProcessorFactoryTest.testTTLDefaultsConversion-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTTLDefaultsConversion
   [junit4]   2> 197480 INFO  (TEST-DocExpirationUpdateProcessorFactoryTest.testAutomaticDeletes-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAutomaticDeletes
   [junit4]   2> 200469 INFO  (autoExpireDocs-1081-thread-1) [    x:collection1] o.a.s.u.p.DocExpirationUpdateProcessorFactory Beginning periodic deletion of expired docs
   [junit4]   2> 200472 INFO  (autoExpireDocs-1081-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1586052308435730432,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 200472 INFO  (autoExpireDocs-1081-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 200472 INFO  (autoExpireDocs-1081-thread-1) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {deleteByQuery={!cache=false}eXpField_tdt:[* TO 2017-12-06T16:22:31.029Z] (-1586052308433633280),commit=} 0 3
   [junit4]   2> 200472 INFO  (autoExpireDocs-1081-thread-1) [    x:collection1] o.a.s.u.p.DocExpirationUpdateProcessorFactory Finished periodic deletion of expired docs
   [junit4]   2> 203468 INFO  (autoExpireDocs-1081-thread-1) [    x:collection1] o.a.s.u.p.DocExpirationUpdateProcessorFactory Beginning periodic deletion of expired docs
   [junit4]   2> 203469 INFO  (autoExpireDocs-1081-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1586052311578312704,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 203469 INFO  (TEST-DocExpirationUpdateProcessorFactoryTest.testAutomaticDeletes-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testAutomaticDeletes
   [junit4]   2> 203469 INFO  (autoExpireDocs-1081-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 203469 INFO  (autoExpireDocs-1081-thread-1) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] {deleteByQuery={!cache=false}eXpField_tdt:[* TO 2017-12-06T16:22:34.028Z] (-1586052311577264128),commit=} 0 1
   [junit4]   2> 203469 INFO  (autoExpireDocs-1081-thread-1) [    x:collection1] o.a.s.u.p.DocExpirationUpdateProcessorFactory Finished periodic deletion of expired docs
   [junit4]   2> 203473 INFO  (TEST-DocExpirationUpdateProcessorFactoryTest.testTTLFieldConversion-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTTLFieldConversion
   [junit4]   2> 203475 INFO  (TEST-DocExpirationUpdateProcessorFactoryTest.testTTLFieldConversion-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTTLFieldConversion
   [junit4]   2> 203478 INFO  (TEST-DocExpirationUpdateProcessorFactoryTest.testTTLFieldConversionWithDefaultParam-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTTLFieldConversionWithDefaultParam
   [junit4]   2> 203479 INFO  (TEST-DocExpirationUpdateProcessorFactoryTest.testTTLFieldConversionWithDefaultParam-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTTLFieldConversionWithDefaultParam
   [junit4]   2> 203479 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 203479 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1991462516
   [junit4]   2> 203479 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 203479 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2786e33e: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@69a10905
   [junit4]   2> 203486 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 203486 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4b0fd9ea: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@68df24ab
   [junit4]   2> 203490 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 203491 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4c0017fd: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@351ae5a2
   [junit4]   2> 203492 INFO  (coreCloseExecutor-1082-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4bd720b9
   [junit4]   2> 203492 INFO  (coreCloseExecutor-1082-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1272389817
   [junit4]   2> 203492 INFO  (coreCloseExecutor-1082-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@46330339: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@54f2283e
   [junit4]   2> 203520 INFO  (coreCloseExecutor-1082-thread-1) [    x:collection1] o.a.s.u.p.DocExpirationUpdateProcessorFactory Triggering Graceful close of DocExpiration Executor
   [junit4]   2> 203522 INFO  (coreCloseExecutor-1082-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
   [junit4]   2> 203522 INFO  (coreCloseExecutor-1082-thread-1) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@5e0a434e commitCommandVersion:0
   [junit4]   2> 203527 INFO  (SUITE-DocExpirationUpdateProcessorFactoryTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1874, maxMBSortInHeap=5.093764403488226, sim=RandomSimilarity(queryNorm=true): {}, locale=zu-ZA, timezone=America/Whitehorse
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=177662144,total=298438656
   [junit4]   2> NOTE: All tests run in this JVM: [TestSQLHandler, TestMissingGroups, TestEmbeddedSolrServerAdminHandler, TestLazyCores, TestHdfsBackupRestoreCore, BlockCacheTest, TestNumericTerms64, DistribJoinFromCollectionTest, TestAddFieldRealTimeGet, CleanupOldIndexTest, ConvertedLegacyTest, TestSizeLimitedDistributedMap, JavabinLoaderTest, TestTrieFacet, TestNonDefinedSimilarityFactory, FacetPivotSmallTest, TestReloadAndDeleteDocs, TestStandardQParsers, HighlighterConfigTest, DistributedTermsComponentTest, TestExactStatsCache, OverseerTest, TestLegacyNumericRangeQueryBuilder, ExplicitHLLTest, SolrXmlInZkTest, TestUnifiedSolrHighlighter, DirectoryFactoryTest, DocExpirationUpdateProcessorFactoryTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DocExpirationUpdateProcessorFactoryTest -Dtests.seed=ECF7D375836B20F6 -Dtests.slow=true -Dtests.locale=zu-ZA -Dtests.timezone=America/Whitehorse -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | DocExpirationUpdateProcessorFactoryTest (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001\tlog: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001\tlog
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.processor.DocExpirationUpdateProcessorFactoryTest_ECF7D375836B20F6-001\init-core-data-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([ECF7D375836B20F6]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [65/751 (2!)] on J0 in 6.41s, 5 tests, 1 error <<< FAILURES!

[...truncated 713 lines...]
   [junit4] Suite: org.apache.solr.response.JSONWriterTest
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001
   [junit4]   2> 1811362 WARN  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=43 numCloses=43
   [junit4]   2> 1811362 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1811364 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 1811364 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1811364 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 1811365 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1811395 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1811416 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 1811502 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1811541 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6ea0e2f3
   [junit4]   2> 1811548 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6ea0e2f3
   [junit4]   2> 1811548 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6ea0e2f3
   [junit4]   2> 1811550 INFO  (coreLoadExecutor-5733-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1811550 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 1811585 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1811604 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1811698 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1811716 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 1811718 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6ea0e2f3
   [junit4]   2> 1811718 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1811718 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\]
   [junit4]   2> 1811719 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=96.208984375, floorSegmentMB=0.5771484375, forceMergeDeletesPctAllowed=21.41624726486349, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4692837045100955
   [junit4]   2> 1811768 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1811768 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1811769 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1811769 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1811770 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=21.501953125, floorSegmentMB=2.052734375, forceMergeDeletesPctAllowed=1.7989111477795505, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.339468179418913
   [junit4]   2> 1811770 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6708f71c[collection1] main]
   [junit4]   2> 1811771 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 1811777 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 1811800 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1811800 INFO  (searcherExecutor-5734-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 1811800 INFO  (coreLoadExecutor-5733-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586053998035599360
   [junit4]   2> 1811801 INFO  (searcherExecutor-5734-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 1811801 INFO  (searcherExecutor-5734-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 1811801 INFO  (searcherExecutor-5734-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 1811801 INFO  (searcherExecutor-5734-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 1811801 INFO  (searcherExecutor-5734-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 1811802 INFO  (searcherExecutor-5734-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 1811802 INFO  (searcherExecutor-5734-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 1811803 INFO  (searcherExecutor-5734-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 1811803 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 1811803 INFO  (searcherExecutor-5734-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6708f71c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1811805 INFO  (TEST-JSONWriterTest.testTypes-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTypes
   [junit4]   2> 1811816 INFO  (TEST-JSONWriterTest.testTypes-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTypes
   [junit4]   2> 1811818 INFO  (TEST-JSONWriterTest.testJSON-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testJSON
   [junit4]   2> 1811819 INFO  (TEST-JSONWriterTest.testJSON-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testJSON
   [junit4]   2> 1811820 INFO  (TEST-JSONWriterTest.testArrntvWriterLacksMethodsOfItsOwn-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testArrntvWriterLacksMethodsOfItsOwn
   [junit4]   2> 1811821 INFO  (TEST-JSONWriterTest.testArrntvWriterLacksMethodsOfItsOwn-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testArrntvWriterLacksMethodsOfItsOwn
   [junit4]   2> 1811822 INFO  (TEST-JSONWriterTest.testConstantsUnchanged-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testConstantsUnchanged
   [junit4]   2> 1811822 INFO  (TEST-JSONWriterTest.testConstantsUnchanged-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testConstantsUnchanged
   [junit4]   2> 1811824 INFO  (TEST-JSONWriterTest.testJSONSolrDocument-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testJSONSolrDocument
   [junit4]   2> 1811825 INFO  (TEST-JSONWriterTest.testJSONSolrDocument-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testJSONSolrDocument
   [junit4]   2> 1811827 INFO  (TEST-JSONWriterTest.testArrntvWriterOverridesAllWrites-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testArrntvWriterOverridesAllWrites
   [junit4]   2> 1811828 INFO  (TEST-JSONWriterTest.testArrntvWriterOverridesAllWrites-seed#[ECF7D375836B20F6]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testArrntvWriterOverridesAllWrites
   [junit4]   2> 1811829 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 1811829 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1956500953
   [junit4]   2> 1811829 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1811829 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@26a7dfa4: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@53faa5a8
   [junit4]   2> 1811832 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1811832 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1fbb1e4e: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@68df24ab
   [junit4]   2> 1811834 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1811834 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@27b3c34e: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@351ae5a2
   [junit4]   2> 1811836 INFO  (coreCloseExecutor-5739-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3962e201
   [junit4]   2> 1811836 INFO  (coreCloseExecutor-5739-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=962781697
   [junit4]   2> 1811836 INFO  (coreCloseExecutor-5739-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@677c9c55: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@8526d5c
   [junit4]   2> 1811847 INFO  (SUITE-JSONWriterTest-seed#[ECF7D375836B20F6]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=727, maxMBSortInHeap=6.674899987378097, sim=RandomSimilarity(queryNorm=true): {}, locale=lkt, timezone=America/Montserrat
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=86473184,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestSQLHandler, TestMissingGroups, TestEmbeddedSolrServerAdminHandler, TestLazyCores, TestHdfsBackupRestoreCore, BlockCacheTest, TestNumericTerms64, DistribJoinFromCollectionTest, TestAddFieldRealTimeGet, CleanupOldIndexTest, ConvertedLegacyTest, TestSizeLimitedDistributedMap, JavabinLoaderTest, TestTrieFacet, TestNonDefinedSimilarityFactory, FacetPivotSmallTest, TestReloadAndDeleteDocs, TestStandardQParsers, HighlighterConfigTest, DistributedTermsComponentTest, TestExactStatsCache, OverseerTest, TestLegacyNumericRangeQueryBuilder, ExplicitHLLTest, SolrXmlInZkTest, TestUnifiedSolrHighlighter, DirectoryFactoryTest, DocExpirationUpdateProcessorFactoryTest, BasicAuthIntegrationTest, CollectionTooManyReplicasTest, TestOmitPositions, ConfigureRecoveryStrategyTest, ShowFileRequestHandlerTest, SolrCoreMetricManagerTest, UnloadDistributedZkTest, BigEndianAscendingWordSerializerTest, OverriddenZkACLAndCredentialsProvidersTest, UniqFieldsUpdateProcessorFactoryTest, NoCacheHeaderTest, HttpTriggerListenerTest, ZkControllerTest, TestRTimerTree, DocValuesMissingTest, DisMaxRequestHandlerTest, ReplicationFactorTest, TestUtils, TestCustomSort, SolrSlf4jReporterTest, UninvertDocValuesMergePolicyTest, DateFieldTest, TestMiniSolrCloudClusterSSL, TestRequestStatusCollectionAPI, DateMathParserTest, TestSubQueryTransformerDistrib, TestPivotHelperCode, TestFiltering, RequestHandlersTest, TestLMDirichletSimilarityFactory, ImplicitSnitchTest, FieldAnalysisRequestHandlerTest, TestConfigSetImmutable, DistributedFacetPivotSmallAdvancedTest, BasicDistributedZkTest, RollingRestartTest, DistanceUnitsTest, TestTestInjection, TestFieldCollectionResource, TestRealTimeGet, CoreAdminCreateDiscoverTest, QueryParsingTest, TestInitParams, GraphQueryTest, TestCloudSchemaless, DeleteInactiveReplicaTest, AlternateDirectoryTest, BlockJoinFacetRandomTest, ClusterStateUpdateTest, ReplicaListTransformerTest, TestDownShardTolerantSearch, RAMDirectoryFactoryTest, TestSimpleTextCodec, TestRangeQuery, NodeLostTriggerTest, SolrCLIZkUtilsTest, TestManagedStopFilterFactory, TestIntervalFaceting, RequiredFieldsTest, TestFilteredDocIdSet, TestXIncludeConfig, ScriptEngineTest, HdfsLockFactoryTest, MultiTermTest, TestCloudJSONFacetJoinDomain, VMParamsZkACLAndCredentialsProvidersTest, TestRecovery, AssignBackwardCompatibilityTest, BufferStoreTest, SuggesterTest, PrimitiveFieldTypeTest, TimeZoneUtilsTest, TestSolrCoreProperties, TestBulkSchemaConcurrent, CollectionReloadTest, TestSolrCloudWithSecureImpersonation, WordBreakSolrSpellCheckerTest, ChaosMonkeySafeLeaderWithPullReplicasTest, TestCloudPseudoReturnFields, HdfsDirectoryFactoryTest, TestSchemaSimilarityResource, TestLegacyFieldReuse, AutoAddReplicasIntegrationTest, MigrateRouteKeyTest, TestPayloadCheckQParserPlugin, TestLocalFSCloudBackupRestore, TestOrdValues, TestDeleteCollectionOnDownNodes, TestPrepRecovery, TestImpersonationWithHadoopAuth, TestFreeTextSuggestions, TestCollectionAPIs, TestCodecSupport, RegexBoostProcessorTest, SpellCheckCollatorTest, TestStressRecovery, AddReplicaTest, TestSolrQueryResponse, SortByFunctionTest, SpellCheckComponentTest, TestSolrConfigHandlerCloud, UUIDFieldTest, PeerSyncReplicationTest, TestSearcherReuse, BinaryUpdateRequestHandlerTest, RecoveryZkTest, TestRandomDVFaceting, SignatureUpdateProcessorFactoryTest, JSONWriterTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=JSONWriterTest -Dtests.seed=ECF7D375836B20F6 -Dtests.slow=true -Dtests.locale=lkt -Dtests.timezone=America/Montserrat -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | JSONWriterTest (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2\write.lock: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001\init-core-data-001\spellchecker2\write.lock
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.response.JSONWriterTest_ECF7D375836B20F6-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([ECF7D375836B20F6]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [291/751 (3!)] on J0 in 0.51s, 6 tests, 1 error <<< FAILURES!

[...truncated 2569 lines...]
   [junit4] Suite: org.apache.solr.common.cloud.TestZkConfigManager
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\init-core-data-001
   [junit4]   2> 262166 WARN  (SUITE-TestZkConfigManager-seed#[6BEC05F531C5AA31]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=35 numCloses=35
   [junit4]   2> 262168 INFO  (SUITE-TestZkConfigManager-seed#[6BEC05F531C5AA31]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 262170 INFO  (SUITE-TestZkConfigManager-seed#[6BEC05F531C5AA31]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 262170 INFO  (SUITE-TestZkConfigManager-seed#[6BEC05F531C5AA31]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 262171 INFO  (SUITE-TestZkConfigManager-seed#[6BEC05F531C5AA31]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 262171 INFO  (Thread-650) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 262171 INFO  (Thread-650) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 262174 ERROR (Thread-650) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 262271 INFO  (SUITE-TestZkConfigManager-seed#[6BEC05F531C5AA31]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:55340
   [junit4]   2> 262274 INFO  (TEST-TestZkConfigManager.testUploadWithACL-seed#[6BEC05F531C5AA31]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testUploadWithACL
   [junit4]   2> 262293 INFO  (zkConnectionManagerCallback-2249-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 262296 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x1602ce6cc1a0000, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 262310 INFO  (zkConnectionManagerCallback-2251-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 262338 INFO  (zkConnectionManagerCallback-2253-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 262346 INFO  (zkConnectionManagerCallback-2255-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 262347 INFO  (TEST-TestZkConfigManager.testUploadWithACL-seed#[6BEC05F531C5AA31]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testUploadWithACL
   [junit4]   2> 262349 INFO  (TEST-TestZkConfigManager.testConstants-seed#[6BEC05F531C5AA31]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testConstants
   [junit4]   2> 262349 INFO  (TEST-TestZkConfigManager.testConstants-seed#[6BEC05F531C5AA31]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testConstants
   [junit4]   2> 262350 INFO  (TEST-TestZkConfigManager.testUploadConfig-seed#[6BEC05F531C5AA31]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testUploadConfig
   [junit4]   2> 262394 INFO  (zkConnectionManagerCallback-2257-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 262433 INFO  (zkConnectionManagerCallback-2259-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 262447 INFO  (TEST-TestZkConfigManager.testUploadConfig-seed#[6BEC05F531C5AA31]) [    ] o.a.s.c.c.ZkMaintenanceUtils uploadToZK skipping '.ignored' due to filenameExclusions '^\..*$'
   [junit4]   2> 262491 INFO  (TEST-TestZkConfigManager.testUploadConfig-seed#[6BEC05F531C5AA31]) [    ] o.a.s.c.c.ZkMaintenanceUtils Writing file C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\download-001\file1
   [junit4]   2> 262498 INFO  (TEST-TestZkConfigManager.testUploadConfig-seed#[6BEC05F531C5AA31]) [    ] o.a.s.c.c.ZkMaintenanceUtils uploadToZK skipping '.ignored' due to filenameExclusions '^\..*$'
   [junit4]   2> 262520 INFO  (TEST-TestZkConfigManager.testUploadConfig-seed#[6BEC05F531C5AA31]) [    ] o.a.s.c.c.ZkMaintenanceUtils Writing file C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\download2-001\file1
   [junit4]   2> 262521 INFO  (TEST-TestZkConfigManager.testUploadConfig-seed#[6BEC05F531C5AA31]) [    ] o.a.s.c.c.ZkMaintenanceUtils uploadToZK skipping '.ignored' due to filenameExclusions '^\..*$'
   [junit4]   2> 262529 INFO  (TEST-TestZkConfigManager.testUploadConfig-seed#[6BEC05F531C5AA31]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testUploadConfig
   [junit4]   2> 262529 ERROR (SUITE-TestZkConfigManager-seed#[6BEC05F531C5AA31]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 262531 INFO  (SUITE-TestZkConfigManager-seed#[6BEC05F531C5AA31]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:55340 55340
   [junit4]   2> 262532 INFO  (Thread-650) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:55340 55340
   [junit4]   2> 262533 INFO  (SUITE-TestZkConfigManager-seed#[6BEC05F531C5AA31]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Dec 06, 2017 5:36:51 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=en-LS, timezone=Europe/Malta
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=83886552,total=243355648
   [junit4]   2> NOTE: All tests run in this JVM: [TestValidatingJsonMap, OrEvaluatorTest, SolrExampleJettyTest, ClientUtilsTest, StreamExpressionParserTest, CloudSolrClientCacheTest, CorrelationEvaluatorTest, EqualToEvaluatorTest, JdbcDriverTest, AscEvaluatorTest, CubedRootEvaluatorTest, DivideEvaluatorTest, TestSolrJErrorHandling, LessThanEqualToEvaluatorTest, UniformDistributionEvaluatorTest, NormalizeEvaluatorTest, TestFastInputStream, StreamExpressionTest, TestV2Request, FieldValueEvaluatorTest, ConcurrentUpdateSolrClientTest, BasicHttpSolrClientTest, StreamExpressionToExplanationTest, HyperbolicTangentEvaluatorTest, GraphExpressionTest, RawValueEvaluatorTest, OperationsTest, SolrQueryTest, QueryResponseTest, SolrPingTest, FacetFieldTest, SquareRootEvaluatorTest, JsonValidatorTest, HyperbolicCosineEvaluatorTest, ArcCosineEvaluatorTest, JDBCStreamTest, StreamExpressionToExpessionTest, StreamingTest, SchemaTest, TestZkConfigManager]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestZkConfigManager -Dtests.seed=6BEC05F531C5AA31 -Dtests.slow=true -Dtests.locale=en-LS -Dtests.timezone=Europe/Malta -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | TestZkConfigManager (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2\log.1: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001\zkData-001\version-2\log.1
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.common.cloud.TestZkConfigManager_6BEC05F531C5AA31-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([6BEC05F531C5AA31]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [142/146 (1!)] on J1 in 0.90s, 3 tests, 1 error <<< FAILURES!

[...truncated 2166 lines...]
   [junit4] Suite: org.apache.solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\contrib\solr-analytics\test\J1\temp\solr.analytics.legacy.facet.LegacyFieldFacetExtrasCloudTest_4ECE90731AC75B2D-001\init-core-data-001
   [junit4]   2> Dec 06, 2017 5:42:45 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=890, maxMBSortInHeap=6.379135393335807, sim=RandomSimilarity(queryNorm=true): {}, locale=ksb-TZ, timezone=America/Rosario
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=56671024,total=151314432
   [junit4]   2> NOTE: All tests run in this JVM: [LegacyAbstractAnalyticsFacetCloudTest, LegacyFacetSortingTest, AbsoluteValueFunctionTest, LegacyNoFacetCloudTest, LongFieldsTest, LTFunctionTest, LegacyExpressionTest, AndFunctionTest, PivotFacetTest, RangeFacetTest, DateFieldsTest, LegacyRangeFacetTest, CeilingFunctionTest, RoundFunctionTest, IfFunctionTest, CastingLongValueStreamTest, ConstantValueTest, LegacyAbstractAnalyticsCloudTest, OrFunctionTest, CastingFloatValueStreamTest, ExpressionFactoryTest, NoFacetTest, AbstractAnalyticsFieldTest, DoubleFieldsTest, FloatFieldsTest, ConcatFunctionTest, DateMathFunctionTest, DateParseFunctionTest, DivideFunctionTest, EqualFunctionTest, ExistsFunctionTest, FillMissingFunctionTest, FilterFunctionTest, GTEFunctionTest, MultFunctionTest, RemoveFunctionTest, SubtractFunctionTest, LegacyFieldFacetExtrasCloudTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=LegacyFieldFacetExtrasCloudTest -Dtests.seed=4ECE90731AC75B2D -Dtests.slow=true -Dtests.locale=ksb-TZ -Dtests.timezone=America/Rosario -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | LegacyFieldFacetExtrasCloudTest (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:56434/solr: create the collection time out:180s
   [junit4]    > at __randomizedtesting.SeedInfo.seed([4ECE90731AC75B2D]:0)
   [junit4]    > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]    > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
   [junit4]    > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
   [junit4]    > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
   [junit4]    > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
   [junit4]    > at org.apache.solr.analytics.legacy.LegacyAbstractAnalyticsCloudTest.setupCollection(LegacyAbstractAnalyticsCloudTest.java:50)
   [junit4]    > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [78/78 (1!)] on J1 in 213.73s, 0 tests, 1 error <<< FAILURES!

[...truncated 37092 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.2-Windows (64bit/jdk1.8.0_144) - Build # 4 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.2-Windows/4/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

5 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.lucene.analysis.snowball.TestSnowballVocab

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006\italian: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006\italian    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006\italian: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006\italian
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006

        at __randomizedtesting.SeedInfo.seed([ADECBEE518E5E152]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.lucene.store.TestMockDirectoryWrapper

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001\tempDir-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001\tempDir-001    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001\tempDir-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001\tempDir-001
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001

        at __randomizedtesting.SeedInfo.seed([FADEB7CB7690F317]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnly

Error Message:
Unexpected number of elements in the group for intGSF: 8

Stack Trace:
java.lang.AssertionError: Unexpected number of elements in the group for intGSF: 8
        at __randomizedtesting.SeedInfo.seed([8647EDC193BF81AA:1DFC8399DEE7B3F4]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnly(DocValuesNotIndexedTest.java:377)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestCorePropertiesReload

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\init-core-data-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\init-core-data-001

        at __randomizedtesting.SeedInfo.seed([8647EDC193BF81AA]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestSQLHandler.doTest

Error Message:


Stack Trace:
java.lang.AssertionError
        at __randomizedtesting.SeedInfo.seed([8647EDC193BF81AA:21035565FE049213]:0)
        at org.apache.solr.handler.TestSQLHandler.testBasicSelect(TestSQLHandler.java:181)
        at org.apache.solr.handler.TestSQLHandler.doTest(TestSQLHandler.java:82)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 1938 lines...]
   [junit4] Suite: org.apache.lucene.store.TestMockDirectoryWrapper
   [junit4] IGNOR/A 0.01s J1 | TestMockDirectoryWrapper.testPendingDeletions
   [junit4]    > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
   [junit4] IGNOR/A 0.01s J1 | TestMockDirectoryWrapper.testFsyncDoesntCreateNewFiles
   [junit4]    > Assumption #1: test only works for FSDirectory subclasses
   [junit4] IGNOR/A 0.00s J1 | TestMockDirectoryWrapper.testThreadSafety
   [junit4]    > Assumption #1: 'nightly' test group is disabled (@Nightly())
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=156, maxMBSortInHeap=6.006204635927804, sim=RandomSimilarity(queryNorm=false): {}, locale=es-EC, timezone=Atlantic/Reykjavik
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=57953512,total=101974016
   [junit4]   2> NOTE: All tests run in this JVM: [Nested1, TestBaseExplanationTestCase, TestAssertingTermVectorsFormat, Nested, Nested2, TestRamUsageTesterOnWildAnimals, TestLookaheadTokenFilter, Nested, TestExtrasFS, TestShuffleFS, TestWorstCaseTestBehavior, TestCompressingStoredFieldsFormat, TestCompressingTermVectorsFormat, TestMockAnalyzer, TestMockDirectoryWrapper]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestMockDirectoryWrapper -Dtests.seed=FADEB7CB7690F317 -Dtests.slow=true -Dtests.locale=es-EC -Dtests.timezone=Atlantic/Reykjavik -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J1 | TestMockDirectoryWrapper (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001\tempDir-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001\tempDir-001
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\test-framework\test\J1\temp\lucene.store.TestMockDirectoryWrapper_FADEB7CB7690F317-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([FADEB7CB7690F317]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [18/41 (1!)] on J1 in 1.04s, 49 tests, 1 error, 3 skipped <<< FAILURES!

[...truncated 633 lines...]
   [junit4] Suite: org.apache.lucene.analysis.snowball.TestSnowballVocab
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=9, maxDocsPerChunk=2, blockSize=34), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=9, blockSize=34)), sim=RandomSimilarity(queryNorm=true): {}, locale=en-IN, timezone=Asia/Pontianak
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=63688360,total=97320960
   [junit4]   2> NOTE: All tests run in this JVM: [TestSimplePatternTokenizer, TestLithuanianStemming, TestFingerprintFilterFactory, TestCapitalizationFilterFactory, TestKeywordMarkerFilterFactory, TestTrimFilter, TestArmenianAnalyzer, TestMappingCharFilter, TestBrazilianAnalyzer, TestGalicianMinimalStemFilterFactory, TestWordDelimiterGraphFilter, TestCodepointCountFilter, TestZeroAffix2, TestKeepFilterFactory, TestTurkishAnalyzer, Test64kAffixes, TestElisionFilterFactory, TestRussianLightStemFilterFactory, TestApostropheFilter, TestArabicStemFilter, TestCaseInsensitive, TestLimitTokenPositionFilter, TestScandinavianFoldingFilter, TestFinnishAnalyzer, TestLatvianStemFilterFactory, TestLengthFilter, TestTwoSuffixes, TestFlagNum, TestASCIIFoldingFilter, TestConv, TestPerFieldAnalyzerWrapper, TestUAX29URLEmailTokenizerFactory, TestBulgarianAnalyzer, TestSnowballVocab]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSnowballVocab -Dtests.seed=ADECBEE518E5E152 -Dtests.slow=true -Dtests.locale=en-IN -Dtests.timezone=Asia/Pontianak -Dtests.asserts=true -Dtests.file.encoding=Cp1252
   [junit4] ERROR   0.00s J0 | TestSnowballVocab (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006\italian: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006\italian
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J0\temp\lucene.analysis.snowball.TestSnowballVocab_ADECBEE518E5E152-001\tempDir-006
   [junit4]    > at __randomizedtesting.SeedInfo.seed([ADECBEE518E5E152]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [106/284 (1!)] on J0 in 23.93s, 1 test, 1 error <<< FAILURES!

[...truncated 9190 lines...]
   [junit4] Suite: org.apache.solr.core.TestCorePropertiesReload
   [junit4]   2> 315131 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\init-core-data-001
   [junit4]   2> 315133 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 315135 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 315139 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testPropertiesReload
   [junit4]   2> 315872 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 315873 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/build/solr-core/test/J1/temp/solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001/tempDir-001/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/build/solr-core/test/J1/temp/solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001/tempDir-001/collection1/lib/classes]
   [junit4]   2> 315976 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 316022 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 316224 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 316465 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 316476 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 316476 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 316487 INFO  (coreLoadExecutor-1433-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 316494 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/build/solr-core/test/J1/temp/solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001/tempDir-001/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/build/solr-core/test/J1/temp/solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001/tempDir-001/collection1/lib/classes]
   [junit4]   2> 316582 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 316608 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 316755 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 316778 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\tempDir-001\collection1, trusted=true
   [junit4]   2> 316778 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 316778 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 316778 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\tempDir-001\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\init-core-data-001\]
   [junit4]   2> 316780 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 316936 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 316937 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 316938 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 316938 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 316939 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=67.009765625, floorSegmentMB=1.4130859375, forceMergeDeletesPctAllowed=15.159421363182604, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 316966 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@10b6c4e4[collection1] main]
   [junit4]   2> 316968 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 316992 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 317090 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 317090 INFO  (searcherExecutor-1434-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 317091 INFO  (coreLoadExecutor-1433-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586100377400377344
   [junit4]   2> 317092 INFO  (searcherExecutor-1434-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 317092 INFO  (searcherExecutor-1434-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 317092 INFO  (searcherExecutor-1434-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 317095 INFO  (searcherExecutor-1434-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 317095 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 317096 INFO  (searcherExecutor-1434-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 317097 ERROR (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.c.CorePropertiesLocator Couldn't load core descriptor from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\tempDir-001\collection1\core.properties:java.nio.file.NoSuchFileException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\tempDir-001\collection1\core.properties
   [junit4]   2> 317098 INFO  (searcherExecutor-1434-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 317099 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/build/solr-core/test/J1/temp/solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001/tempDir-001/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/build/solr-core/test/J1/temp/solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001/tempDir-001/collection1/lib/classes]
   [junit4]   2> 317102 INFO  (searcherExecutor-1434-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 317109 INFO  (searcherExecutor-1434-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 317110 INFO  (searcherExecutor-1434-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@10b6c4e4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 317212 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 317254 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 317408 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 317431 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    ] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\tempDir-001\collection1
   [junit4]   2> 317481 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 317481 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\tempDir-001\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\init-core-data-001\]
   [junit4]   2> 318049 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 318049 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 318069 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5e0017a6[collection1] main]
   [junit4]   2> 318071 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 318075 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 318100 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 318101 INFO  (searcherExecutor-1439-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 318108 INFO  (searcherExecutor-1439-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 318108 INFO  (searcherExecutor-1439-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 318108 INFO  (searcherExecutor-1439-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 318108 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586100378466779136
   [junit4]   2> 318110 INFO  (searcherExecutor-1439-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 318111 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=43, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.48150846507743883]
   [junit4]   2> 318111 INFO  (searcherExecutor-1439-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 318115 INFO  (searcherExecutor-1439-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 318119 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 318123 INFO  (searcherExecutor-1439-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 318129 INFO  (searcherExecutor-1439-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 318133 INFO  (searcherExecutor-1439-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5e0017a6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 318133 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@467473ac[collection1] main]
   [junit4]   2> 318134 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6bcf8e40
   [junit4]   2> 318134 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1808764480
   [junit4]   2> 318134 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@492332f4: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@1b682e59
   [junit4]   2> 318137 INFO  (searcherExecutor-1439-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@467473ac[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 318158 INFO  (TEST-TestCorePropertiesReload.testPropertiesReload-seed#[8647EDC193BF81AA]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testPropertiesReload
   [junit4]   2> 318159 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 318160 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1238487331
   [junit4]   2> 318160 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 318160 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@43cc40a2: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@5ef4b177
   [junit4]   2> 318167 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 318167 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7a8b4404: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@778d3421
   [junit4]   2> 318172 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 318172 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3b6b6642: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5d2ab73d
   [junit4]   2> 318178 INFO  (coreCloseExecutor-1443-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5a861e24
   [junit4]   2> 318178 INFO  (coreCloseExecutor-1443-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1518738980
   [junit4]   2> 318178 INFO  (coreCloseExecutor-1443-thread-1-processing-x:collection1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@572fcc3: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@1b682e59
   [junit4]   2> 318223 INFO  (SUITE-TestCorePropertiesReload-seed#[8647EDC193BF81AA]-worker) [    x:collection1] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=7, maxDocsPerChunk=2, blockSize=5), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=7, blockSize=5)), sim=RandomSimilarity(queryNorm=false): {}, locale=es-CO, timezone=Asia/Samarkand
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=101736624,total=202977280
   [junit4]   2> NOTE: All tests run in this JVM: [TestSchemaResource, TestRetrieveFieldsOptimizer, TestDocSet, TestStressUserVersions, ZkNodePropsTest, SolrPluginUtilsTest, TestRandomFaceting, TestCloudManagedSchema, DistributedIntervalFacetingTest, DateRangeFieldTest, AssignTest, TestValueSourceCache, OverseerCollectionConfigSetProcessorTest, TestSearchPerf, TestPartialUpdateDeduplication, LegacyCloudClusterPropTest, TestMacros, SystemInfoHandlerTest, CloudExitableDirectoryReaderTest, OpenExchangeRatesOrgProviderTest, TestSimpleTrackingShardHandler, TestFieldCacheWithThreads, TestStressLiveNodes, HdfsRecoveryZkTest, SolrIndexConfigTest, TestSolrCLIRunExample, BasicFunctionalityTest, SolrIndexSplitterTest, TestNumericTerms32, TestStressReorder, TestUseDocValuesAsStored, TestSlowCompositeReaderWrapper, MissingSegmentRecoveryTest, TestExceedMaxTermLength, TestClusterStateMutator, DirectSolrSpellCheckerTest, TestFieldSortValues, TestQueryUtils, TestIndexSearcher, BasicZkTest, TimeRoutedAliasUpdateProcessorTest, TestDefaultStatsCache, TestQueryTypes, TestHttpShardHandlerFactory, PolyFieldTest, TestInitQParser, V2ApiIntegrationTest, SmileWriterTest, ZkStateWriterTest, TestCorePropertiesReload]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCorePropertiesReload -Dtests.seed=8647EDC193BF81AA -Dtests.slow=true -Dtests.locale=es-CO -Dtests.timezone=Asia/Samarkand -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestCorePropertiesReload (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.core.TestCorePropertiesReload_8647EDC193BF81AA-001\init-core-data-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([8647EDC193BF81AA]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [66/751 (1!)] on J1 in 3.45s, 1 test, 1 error <<< FAILURES!

[...truncated 636 lines...]
   [junit4] Suite: org.apache.solr.cloud.DocValuesNotIndexedTest
   [junit4]   2> 1252995 INFO  (SUITE-DocValuesNotIndexedTest-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\init-core-data-001
   [junit4]   2> 1252997 WARN  (SUITE-DocValuesNotIndexedTest-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 1252998 INFO  (SUITE-DocValuesNotIndexedTest-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1253004 INFO  (SUITE-DocValuesNotIndexedTest-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1253007 INFO  (SUITE-DocValuesNotIndexedTest-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\tempDir-001
   [junit4]   2> 1253007 INFO  (SUITE-DocValuesNotIndexedTest-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1253012 INFO  (Thread-2521) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1253012 INFO  (Thread-2521) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1253019 ERROR (Thread-2521) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1253107 INFO  (SUITE-DocValuesNotIndexedTest-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:53944
   [junit4]   2> 1253118 INFO  (zkConnectionManagerCallback-4152-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1253132 INFO  (jetty-launcher-4149-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1253133 INFO  (jetty-launcher-4149-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@56805899{/solr,null,AVAILABLE}
   [junit4]   2> 1253135 INFO  (jetty-launcher-4149-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@77f8fbe1{HTTP/1.1,[http/1.1]}{127.0.0.1:53948}
   [junit4]   2> 1253135 INFO  (jetty-launcher-4149-thread-1) [    ] o.e.j.s.Server Started @1261046ms
   [junit4]   2> 1253135 INFO  (jetty-launcher-4149-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53948}
   [junit4]   2> 1253135 ERROR (jetty-launcher-4149-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1253136 INFO  (jetty-launcher-4149-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 1253136 INFO  (jetty-launcher-4149-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1253136 INFO  (jetty-launcher-4149-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1253136 INFO  (jetty-launcher-4149-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-07T05:22:09.214Z
   [junit4]   2> 1253137 INFO  (jetty-launcher-4149-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1253137 INFO  (jetty-launcher-4149-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@50eaf66a{/solr,null,AVAILABLE}
   [junit4]   2> 1253138 INFO  (jetty-launcher-4149-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@48e26461{HTTP/1.1,[http/1.1]}{127.0.0.1:53953}
   [junit4]   2> 1253138 INFO  (jetty-launcher-4149-thread-2) [    ] o.e.j.s.Server Started @1261050ms
   [junit4]   2> 1253138 INFO  (jetty-launcher-4149-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53953}
   [junit4]   2> 1253140 ERROR (jetty-launcher-4149-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1253144 INFO  (jetty-launcher-4149-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 1253144 INFO  (jetty-launcher-4149-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1253144 INFO  (jetty-launcher-4149-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1253144 INFO  (jetty-launcher-4149-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-07T05:22:09.222Z
   [junit4]   2> 1253150 INFO  (zkConnectionManagerCallback-4154-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1253165 INFO  (jetty-launcher-4149-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1253166 INFO  (zkConnectionManagerCallback-4156-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1253167 INFO  (jetty-launcher-4149-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1253186 INFO  (jetty-launcher-4149-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53944/solr
   [junit4]   2> 1253189 INFO  (zkConnectionManagerCallback-4160-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1253199 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x1602f6c84490003, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1253200 INFO  (jetty-launcher-4149-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53944/solr
   [junit4]   2> 1253210 INFO  (zkConnectionManagerCallback-4164-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1253210 INFO  (zkConnectionManagerCallback-4166-thread-1-processing-n:127.0.0.1:53948_solr) [n:127.0.0.1:53948_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1253216 INFO  (zkConnectionManagerCallback-4168-thread-1-processing-n:127.0.0.1:53953_solr) [n:127.0.0.1:53953_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1253368 INFO  (jetty-launcher-4149-thread-2) [n:127.0.0.1:53953_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1253369 INFO  (jetty-launcher-4149-thread-1) [n:127.0.0.1:53948_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1253369 INFO  (jetty-launcher-4149-thread-2) [n:127.0.0.1:53953_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53953_solr
   [junit4]   2> 1253371 INFO  (jetty-launcher-4149-thread-2) [n:127.0.0.1:53953_solr    ] o.a.s.c.Overseer Overseer (id=99131334924500998-127.0.0.1:53953_solr-n_0000000000) starting
   [junit4]   2> 1253372 INFO  (jetty-launcher-4149-thread-1) [n:127.0.0.1:53948_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53948_solr
   [junit4]   2> 1253376 INFO  (zkCallback-4167-thread-1-processing-n:127.0.0.1:53953_solr) [n:127.0.0.1:53953_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1253383 INFO  (zkCallback-4165-thread-1-processing-n:127.0.0.1:53948_solr) [n:127.0.0.1:53948_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1253390 INFO  (jetty-launcher-4149-thread-2) [n:127.0.0.1:53953_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53953_solr
   [junit4]   2> 1253392 INFO  (zkCallback-4167-thread-1-processing-n:127.0.0.1:53953_solr) [n:127.0.0.1:53953_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1253392 INFO  (zkCallback-4165-thread-1-processing-n:127.0.0.1:53948_solr) [n:127.0.0.1:53948_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1253602 INFO  (jetty-launcher-4149-thread-1) [n:127.0.0.1:53948_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53948.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 1253603 INFO  (jetty-launcher-4149-thread-2) [n:127.0.0.1:53953_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53953.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 1253610 INFO  (jetty-launcher-4149-thread-2) [n:127.0.0.1:53953_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53953.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 1253611 INFO  (jetty-launcher-4149-thread-2) [n:127.0.0.1:53953_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53953.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 1253611 INFO  (jetty-launcher-4149-thread-1) [n:127.0.0.1:53948_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53948.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 1253611 INFO  (jetty-launcher-4149-thread-1) [n:127.0.0.1:53948_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53948.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 1253612 INFO  (jetty-launcher-4149-thread-2) [n:127.0.0.1:53953_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\tempDir-001\node2\.
   [junit4]   2> 1253613 INFO  (jetty-launcher-4149-thread-1) [n:127.0.0.1:53948_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\tempDir-001\node1\.
   [junit4]   2> 1253688 INFO  (zkConnectionManagerCallback-4173-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1253695 INFO  (zkConnectionManagerCallback-4177-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1253701 INFO  (SUITE-DocValuesNotIndexedTest-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1253702 INFO  (SUITE-DocValuesNotIndexedTest-seed#[8647EDC193BF81AA]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53944/solr ready
   [junit4]   2> 1253722 INFO  (qtp1590034843-15802) [n:127.0.0.1:53948_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&maxShardsPerNode=2&name=dv_coll&nrtReplicas=1&action=CREATE&numShards=4&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1253731 INFO  (OverseerThreadFactory-4578-thread-1-processing-n:127.0.0.1:53953_solr) [n:127.0.0.1:53953_solr    ] o.a.s.c.CreateCollectionCmd Create collection dv_coll
   [junit4]   2> 1253846 INFO  (OverseerStateUpdate-99131334924500998-127.0.0.1:53953_solr-n_0000000000) [n:127.0.0.1:53953_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"dv_coll_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:53953/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 1253849 INFO  (OverseerStateUpdate-99131334924500998-127.0.0.1:53953_solr-n_0000000000) [n:127.0.0.1:53953_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"dv_coll_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:53948/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 1253851 INFO  (OverseerStateUpdate-99131334924500998-127.0.0.1:53953_solr-n_0000000000) [n:127.0.0.1:53953_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"dv_coll_shard3_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:53953/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 1253854 INFO  (OverseerStateUpdate-99131334924500998-127.0.0.1:53953_solr-n_0000000000) [n:127.0.0.1:53953_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"dv_coll_shard4_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:53948/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"}
   [junit4]   2> 1254059 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=dv_coll_shard4_replica_n6&action=CREATE&numShards=4&collection=dv_coll&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1254059 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=dv_coll_shard3_replica_n4&action=CREATE&numShards=4&collection=dv_coll&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1254060 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1254061 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1254065 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=dv_coll_shard2_replica_n2&action=CREATE&numShards=4&collection=dv_coll&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1254078 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=dv_coll_shard1_replica_n1&action=CREATE&numShards=4&collection=dv_coll&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1254191 INFO  (zkCallback-4167-thread-1-processing-n:127.0.0.1:53953_solr) [n:127.0.0.1:53953_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1254192 INFO  (zkCallback-4165-thread-1-processing-n:127.0.0.1:53948_solr) [n:127.0.0.1:53948_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1254193 INFO  (zkCallback-4167-thread-2-processing-n:127.0.0.1:53953_solr) [n:127.0.0.1:53953_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1254193 INFO  (zkCallback-4165-thread-2-processing-n:127.0.0.1:53948_solr) [n:127.0.0.1:53948_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1254193 INFO  (zkCallback-4165-thread-3-processing-n:127.0.0.1:53948_solr) [n:127.0.0.1:53948_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1255132 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1255133 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1255134 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1255141 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1255143 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.IndexSchema [dv_coll_shard4_replica_n6] Schema name=minimal
   [junit4]   2> 1255143 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.IndexSchema [dv_coll_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1255147 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.IndexSchema [dv_coll_shard3_replica_n4] Schema name=minimal
   [junit4]   2> 1255149 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1255149 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard4_replica_n6' using configuration from collection dv_coll, trusted=true
   [junit4]   2> 1255150 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.IndexSchema [dv_coll_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 1255150 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53948.solr.core.dv_coll.shard4.replica_n6' (registry 'solr.core.dv_coll.shard4.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 1255150 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1255150 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard3_replica_n4' using configuration from collection dv_coll, trusted=true
   [junit4]   2> 1255150 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1255150 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SolrCore [[dv_coll_shard4_replica_n6] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\tempDir-001\node1\dv_coll_shard4_replica_n6], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\tempDir-001\node1\.\dv_coll_shard4_replica_n6\data\]
   [junit4]   2> 1255150 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53953.solr.core.dv_coll.shard3.replica_n4' (registry 'solr.core.dv_coll.shard3.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 1255151 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1255151 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [[dv_coll_shard3_replica_n4] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\tempDir-001\node2\dv_coll_shard3_replica_n4], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\tempDir-001\node2\.\dv_coll_shard3_replica_n4\data\]
   [junit4]   2> 1255152 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1255152 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard2_replica_n2' using configuration from collection dv_coll, trusted=true
   [junit4]   2> 1255153 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53948.solr.core.dv_coll.shard2.replica_n2' (registry 'solr.core.dv_coll.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 1255153 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1255153 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SolrCore [[dv_coll_shard2_replica_n2] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\tempDir-001\node1\dv_coll_shard2_replica_n2], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\tempDir-001\node1\.\dv_coll_shard2_replica_n2\data\]
   [junit4]   2> 1255156 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1255156 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard1_replica_n1' using configuration from collection dv_coll, trusted=true
   [junit4]   2> 1255156 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53953.solr.core.dv_coll.shard1.replica_n1' (registry 'solr.core.dv_coll.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@64f62449
   [junit4]   2> 1255156 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1255157 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SolrCore [[dv_coll_shard1_replica_n1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\tempDir-001\node2\dv_coll_shard1_replica_n1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.DocValuesNotIndexedTest_8647EDC193BF81AA-001\tempDir-001\node2\.\dv_coll_shard1_replica_n1\data\]
   [junit4]   2> 1255312 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1255312 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1255315 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1255315 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1255315 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1255315 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1255318 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1255318 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1255322 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1255322 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1255324 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1255325 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1255326 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b6eddb7[dv_coll_shard4_replica_n6] main]
   [junit4]   2> 1255329 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1255329 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1255329 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@1fb571e1[dv_coll_shard2_replica_n2] main]
   [junit4]   2> 1255329 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 1255330 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1255330 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1255331 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1255331 INFO  (searcherExecutor-4583-thread-1-processing-n:127.0.0.1:53948_solr x:dv_coll_shard4_replica_n6 s:shard4 c:dv_coll r:core_node8) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SolrCore [dv_coll_shard4_replica_n6] Registered new searcher Searcher@1b6eddb7[dv_coll_shard4_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1255332 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586101361217372160
   [junit4]   2> 1255332 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1255332 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 1255332 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1255337 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@21fc88c6[dv_coll_shard3_replica_n4] main]
   [junit4]   2> 1255337 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1255337 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586101361222615040
   [junit4]   2> 1255339 INFO  (searcherExecutor-4585-thread-1-processing-n:127.0.0.1:53948_solr x:dv_coll_shard2_replica_n2 s:shard2 c:dv_coll r:core_node5) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SolrCore [dv_coll_shard2_replica_n2] Registered new searcher Searcher@1fb571e1[dv_coll_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1255343 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1255343 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1255343 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 1255344 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1255345 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1255345 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586101361231003648
   [junit4]   2> 1255346 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1255346 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1255346 INFO  (searcherExecutor-4584-thread-1-processing-n:127.0.0.1:53953_solr x:dv_coll_shard3_replica_n4 s:shard3 c:dv_coll r:core_node7) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [dv_coll_shard3_replica_n4] Registered new searcher Searcher@21fc88c6[dv_coll_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1255348 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1255348 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1255348 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1255348 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1255348 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1255348 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53948/solr/dv_coll_shard2_replica_n2/
   [junit4]   2> 1255348 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1255349 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53948/solr/dv_coll_shard4_replica_n6/
   [junit4]   2> 1255349 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1255349 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1255349 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SyncStrategy http://127.0.0.1:53948/solr/dv_coll_shard2_replica_n2/ has no replicas
   [junit4]   2> 1255349 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1255349 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SyncStrategy http://127.0.0.1:53948/solr/dv_coll_shard4_replica_n6/ has no replicas
   [junit4]   2> 1255349 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1255352 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1255352 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1255352 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53953/solr/dv_coll_shard3_replica_n4/
   [junit4]   2> 1255352 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1255352 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SyncStrategy http://127.0.0.1:53953/solr/dv_coll_shard3_replica_n4/ has no replicas
   [junit4]   2> 1255352 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1255354 INFO  (qtp1590034843-15788) [n:127.0.0.1:53948_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:53948/solr/dv_coll_shard2_replica_n2/ shard2
   [junit4]   2> 1255354 INFO  (qtp1590034843-15789) [n:127.0.0.1:53948_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:53948/solr/dv_coll_shard4_replica_n6/ shard4
   [junit4]   2> 1255354 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@427edca2[dv_coll_shard1_replica_n1] main]
   [junit4]   2> 1255356 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1255357 INFO  (qtp1627268491-15798) [n:127.0.0.1:53953_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:53953/solr/dv_coll_shard3_replica_n4/ shard3
   [junit4]   2> 1255357 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1255357 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 1255357 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1255358 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1255359 INFO  (searcherExecutor-4586-thread-1-processing-n:127.0.0.1:53953_solr x:dv_coll_shard1_replica_n1 s:shard1 c:dv_coll r:core_node3) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SolrCore [dv_coll_shard1_replica_n1] Registered new searcher Searcher@427edca2[dv_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1255359 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586101361245683712
   [junit4]   2> 1255367 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1255367 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1255367 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53953/solr/dv_coll_shard1_replica_n1/
   [junit4]   2> 1255367 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1255367 INFO  (qtp1627268491-15796) [n:127.0.0.1:53953_solr c:dv_coll s:shard1 r:core_node3 x:

[...truncated too long message...]

per server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 3301398 INFO  (TEST-TestSQLHandler.doTest-seed#[8647EDC193BF81AA]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49626 49626
   [junit4]   2> 3301399 INFO  (Thread-5155) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49626 49626
   [junit4]   2> 3301400 WARN  (Thread-5155) [    ] o.a.s.c.ZkTestServer Watch limit violations:
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2>
   [junit4]   2> 26 /solr/aliases.json
   [junit4]   2> 5 /solr/security.json
   [junit4]   2> 5 /solr/configs/conf1
   [junit4]   2> 4 /solr/collections/collection1/state.json
   [junit4]   2>
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2>
   [junit4]   2> 26 /solr/clusterstate.json
   [junit4]   2> 26 /solr/clusterprops.json
   [junit4]   2> 5 /solr/autoscaling.json
   [junit4]   2>
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2>
   [junit4]   2> 26 /solr/live_nodes
   [junit4]   2> 26 /solr/collections
   [junit4]   2> 5 /solr/overseer/queue
   [junit4]   2> 5 /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 5 /solr/overseer/collection-queue-work
   [junit4]   2> 5 /solr/overseer/queue-work
   [junit4]   2>
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSQLHandler -Dtests.method=doTest -Dtests.seed=8647EDC193BF81AA -Dtests.slow=true -Dtests.locale=sr-ME -Dtests.timezone=Pacific/Guam -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 31.2s J0 | TestSQLHandler.doTest <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > at __randomizedtesting.SeedInfo.seed([8647EDC193BF81AA:21035565FE049213]:0)
   [junit4]    > at org.apache.solr.handler.TestSQLHandler.testBasicSelect(TestSQLHandler.java:181)
   [junit4]    > at org.apache.solr.handler.TestSQLHandler.doTest(TestSQLHandler.java:82)
   [junit4]    > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
   [junit4]    > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSQLHandler_8647EDC193BF81AA-001
   [junit4]   2> Dec 07, 2017 5:56:17 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=sr-ME, timezone=Pacific/Guam
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=160947704,total=372056064
   [junit4]   2> NOTE: All tests run in this JVM: [TestEmbeddedSolrServerAdminHandler, DistributedFacetPivotLargeTest, TestCloudJSONFacetJoinDomain, TestFieldCacheSort, SolrXmlInZkTest, TestOrdValues, PKIAuthenticationIntegrationTest, MigrateRouteKeyTest, MoveReplicaTest, TestSystemCollAutoCreate, SolrJmxReporterCloudTest, TestPrepRecovery, TestQueryWrapperFilter, CoreAdminCreateDiscoverTest, TestCoreDiscovery, TestStressInPlaceUpdates, V2StandaloneTest, SolrSlf4jReporterTest, ClusterStateUpdateTest, DistanceUnitsTest, TestFiltering, AutoScalingHandlerTest, TestSolr4Spatial, HdfsCollectionsAPIDistributedZkTest, TestReversedWildcardFilterFactory, ReplicationFactorTest, RequiredFieldsTest, TestNumericTerms64, TestIBSimilarityFactory, PeerSyncReplicationTest, TestDownShardTolerantSearch, DistributedFacetPivotWhiteBoxTest, TestIntervalFaceting, TestReplicaProperties, DistributedFacetPivotSmallAdvancedTest, TestTolerantUpdateProcessorRandomCloud, TestGraphMLResponseWriter, PrimitiveFieldTypeTest, RankQueryTest, TestSubQueryTransformer, TestLFUCache, TestSurroundQueryParser, TestLocalFSCloudBackupRestore, DisMaxRequestHandlerTest, MetricsHandlerTest, AutoAddReplicasIntegrationTest, TestFreeTextSuggestions, HdfsUnloadDistributedZkTest, TestXmlQParserPlugin, HighlighterTest, TestConfigReload, TestRangeQuery, TestSerializedLuceneMatchVersion, SparseHLLTest, RemoteQueryErrorTest, CdcrBidirectionalTest, DistributedVersionInfoTest, TestBinaryField, XmlUpdateRequestHandlerTest, TestConfigSetsAPIZkFailure, ClusterStateTest, DistributedExpandComponentTest, CheckHdfsIndexTest, JvmMetricsTest, TestClassicSimilarityFactory, HdfsRestartWhileUpdatingTest, TestExportWriter, BooleanFieldTest, TestPhraseSuggestions, TestUtils, TestReloadAndDeleteDocs, RecoveryZkTest, TestInPlaceUpdatesStandalone, RequestHandlersTest, FacetPivotSmallTest, TestCloudSchemaless, ReturnFieldsTest, ForceLeaderTest, TestRecoveryHdfs, LeaderElectionTest, TestLeaderElectionZkExpiry, AtomicUpdateProcessorFactoryTest, ParsingFieldUpdateProcessorsTest, TestPKIAuthenticationPlugin, TestConfigSets, TestLegacyFieldCache, OverseerTest, SpellCheckComponentTest, SolrRequestParserTest, HdfsRecoverLeaseTest, JSONWriterTest, JavabinLoaderTest, ConvertedLegacyTest, ManagedSchemaRoundRobinCloudTest, SolrCoreMetricManagerTest, DeleteShardTest, CollectionReloadTest, RulesTest, TestBlendedInfixSuggestions, CdcrReplicationDistributedZkTest, TestSweetSpotSimilarityFactory, TestNumericRangeQuery32, TestPushWriter, ChaosMonkeySafeLeaderWithPullReplicasTest, BlockJoinFacetRandomTest, TestRTimerTree, TestPivotHelperCode, DateFieldTest, BadIndexSchemaTest, SignatureUpdateProcessorFactoryTest, TestManagedStopFilterFactory, LargeFieldTest, ChaosMonkeyNothingIsSafeTest, ExecutePlanActionTest, TestStandardQParsers, DefaultValueUpdateProcessorTest, SecurityConfHandlerTest, IndexSchemaTest, DistribCursorPagingTest, ScriptEngineTest, DistributedTermsComponentTest, TestMiniSolrCloudClusterSSL, TestImpersonationWithHadoopAuth, SpatialFilterTest, TestMaxTokenLenTokenizer, VMParamsZkACLAndCredentialsProvidersTest, CursorPagingTest, AddBlockUpdateTest, TestScoreJoinQPScore, TestJoin, DistributedQueryElevationComponentTest, SolrTestCaseJ4Test, ZkControllerTest, SolrGangliaReporterTest, SuggesterTest, TestPullReplicaErrorHandling, TestOmitPositions, DirectUpdateHandlerOptimizeTest, SolrInfoBeanTest, MinimalSchemaTest, SolrCLIZkUtilsTest, TestRawTransformer, TestSchemalessBufferedUpdates, TestFieldCacheVsDocValues, HdfsThreadLeakTest, TestComplexPhraseLeadingWildcard, ZkStateReaderTest, TestJmxIntegration, TestFieldCollectionResource, PathHierarchyTokenizerFactoryTest, TestCloudDeleteByQuery, SliceStateTest, CSVRequestHandlerTest, TestPayloadCheckQParserPlugin, TestFieldTypeCollectionResource, TimeZoneUtilsTest, PeerSyncWithIndexFingerprintCachingTest, ReplicaListTransformerTest, TestLegacyFieldReuse, SuggestComponentTest, TestRandomDVFaceting, TestPseudoReturnFields, AsyncCallRequestStatusResponseTest, HdfsDirectoryFactoryTest, NoCacheHeaderTest, StressHdfsTest, TestManagedSynonymGraphFilterFactory, TestFuzzyAnalyzedSuggestions, WordBreakSolrSpellCheckerTest, TestConfigSetsAPI, TestDocBasedVersionConstraints, TestFilteredDocIdSet, TolerantUpdateProcessorTest, TestInitParams, TestConfigSetImmutable, TestExpandComponent, TestSolrXml, CloudMLTQParserTest, TestCustomSort, DirectUpdateHandlerTest, AnalyticsQueryTest, HighlighterConfigTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, FullSolrCloudDistribCmdsTest, ZkSolrClientTest, ZkCLITest, TestDistributedSearch, TestDistributedGrouping, TestHashPartitioner, TermVectorComponentDistributedTest, TestReload, SimpleFacetsTest, SolrCoreTest, TestGroupingSearch, SolrCmdDistributorTest, TestSort, TestLazyCores, TestFoldingMultitermQuery, DocValuesTest, TestWordDelimiterFilterFactory, SortByFunctionTest, TestRemoteStreaming, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, FileBasedSpellCheckerTest, TermVectorComponentTest, TestIndexingPerformance, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, TestCollationField, TestCSVResponseWriter, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, PingRequestHandlerTest, TestComponentsName, SearchHandlerTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, ResponseLogComponentTest, BadComponentTest, TestStressRecovery, TestSolrDeletionPolicy2, MultiTermTest, NumericFieldsTest, TestElisionMultitermQuery, TestConfig, TestSolrCoreProperties, DirectSolrConnectionTest, TestLuceneMatchVersion, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestBM25SimilarityFactory, URLClassifyProcessorTest, PreAnalyzedFieldTest, RAMDirectoryFactoryTest, TestDocumentBuilder, UUIDFieldTest, CircularListTest, DistributedMLTComponentTest, TestLuceneIndexBackCompat, AddReplicaTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, ConfigSetsAPITest, CreateCollectionCleanupTest, DeleteInactiveReplicaTest, DeleteNodeTest, DistribJoinFromCollectionTest, HttpPartitionTest, ReplaceNodeTest, SaslZkACLProviderTest, SolrCloudExampleTest, TestCloudPseudoReturnFields, TestCloudSearcherWarming, TestDeleteCollectionOnDownNodes, TestOnReconnectListenerSupport, TestRebalanceLeaders, TestSegmentSorting, TestSolrCloudWithDelegationTokens, TestSolrCloudWithKerberosAlt, TestTolerantUpdateProcessorCloud, TlogReplayBufferedWhileIndexingTest, TriLevelCompositeIdRoutingTest, ZkFailoverTest, TriggerIntegrationTest, TestSolrCoreSnapshots, TestSQLHandler]
   [junit4] Completed [605/751 (3!)] on J0 in 31.70s, 1 test, 1 failure <<< FAILURES!

[...truncated 47903 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.2-Windows (32bit/jdk1.8.0_144) - Build # 5 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.2-Windows/5/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:56849/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:56849/collection1
        at __randomizedtesting.SeedInfo.seed([692993E6D86F4A55:E17DAC3C769327AD]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:484)
        at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:463)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.commit(AbstractFullDistribZkTestBase.java:1582)
        at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:212)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
        at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
        at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
        at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
        at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
        at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
        at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
        at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
        at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
        at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
        at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
        at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
        at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
        at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
        at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
        ... 53 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest

Error Message:
8 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest:     1) Thread[id=4153, name=zkCallback-963-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=4177, name=zkCallback-963-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    3) Thread[id=4024, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]-EventThread, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)    4) Thread[id=4025, name=zkConnectionManagerCallback-964-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    5) Thread[id=4187, name=zkCallback-963-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    6) Thread[id=4023, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]-SendThread(127.0.0.1:56728), state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)    7) Thread[id=4022, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)    8) Thread[id=4027, name=zkCallback-963-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 8 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest:
   1) Thread[id=4153, name=zkCallback-963-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=4177, name=zkCallback-963-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   3) Thread[id=4024, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]-EventThread, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
   4) Thread[id=4025, name=zkConnectionManagerCallback-964-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   5) Thread[id=4187, name=zkCallback-963-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   6) Thread[id=4023, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]-SendThread(127.0.0.1:56728), state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
   7) Thread[id=4022, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
   8) Thread[id=4027, name=zkCallback-963-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([692993E6D86F4A55]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=4153, name=zkCallback-963-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=4177, name=zkCallback-963-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    3) Thread[id=4025, name=zkConnectionManagerCallback-964-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    4) Thread[id=4187, name=zkCallback-963-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    5) Thread[id=4023, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]-SendThread(127.0.0.1:56728), state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)    6) Thread[id=4027, name=zkCallback-963-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=4153, name=zkCallback-963-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=4177, name=zkCallback-963-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   3) Thread[id=4025, name=zkConnectionManagerCallback-964-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   4) Thread[id=4187, name=zkCallback-963-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   5) Thread[id=4023, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]-SendThread(127.0.0.1:56728), state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
   6) Thread[id=4027, name=zkCallback-963-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([692993E6D86F4A55]:0)




Build Log:
[...truncated 11973 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\init-core-data-001
   [junit4]   2> 485487 WARN  (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[692993E6D86F4A55]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 485488 INFO  (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[692993E6D86F4A55]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 485492 INFO  (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[692993E6D86F4A55]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 485492 INFO  (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[692993E6D86F4A55]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 485493 INFO  (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[692993E6D86F4A55]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 485495 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 485496 INFO  (Thread-860) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 485496 INFO  (Thread-860) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 485499 ERROR (Thread-860) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 485596 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.ZkTestServer start zk server on port:56728
   [junit4]   2> 485600 INFO  (zkConnectionManagerCallback-944-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 485605 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160320d08810000, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 485608 INFO  (zkConnectionManagerCallback-946-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 485617 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 485620 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 485622 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 485623 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 485625 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 485627 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 485629 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 485631 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 485634 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 485637 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 485639 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 485641 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160320d08810001, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 485642 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 486162 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 486163 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@10c1a73{/,null,AVAILABLE}
   [junit4]   2> 486166 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@d7905a{HTTP/1.1,[http/1.1]}{127.0.0.1:56735}
   [junit4]   2> 486166 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.Server Started @493347ms
   [junit4]   2> 486166 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\tempDir-001/control/data, hostContext=/, hostPort=56735, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\control-001\cores}
   [junit4]   2> 486166 ERROR (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 486166 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 486166 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 486166 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 486166 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-07T17:36:43.804Z
   [junit4]   2> 486170 INFO  (zkConnectionManagerCallback-948-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 486172 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 486173 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\control-001\solr.xml
   [junit4]   2> 486186 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 486186 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 486188 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 486194 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56728/solr
   [junit4]   2> 486196 INFO  (zkConnectionManagerCallback-952-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 486198 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160320d08810003, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 486201 INFO  (zkConnectionManagerCallback-954-thread-1-processing-n:127.0.0.1:56735_) [n:127.0.0.1:56735_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 486344 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56735_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 486345 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56735_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:56735_
   [junit4]   2> 486346 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56735_    ] o.a.s.c.Overseer Overseer (id=99134223360786436-127.0.0.1:56735_-n_0000000000) starting
   [junit4]   2> 486357 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56735_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56735_
   [junit4]   2> 486363 INFO  (OverseerStateUpdate-99134223360786436-127.0.0.1:56735_-n_0000000000) [n:127.0.0.1:56735_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 486698 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56735_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 486710 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56735_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 486710 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56735_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 486713 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56735_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\control-001\cores
   [junit4]   2> 486752 INFO  (zkConnectionManagerCallback-960-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 486755 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 486756 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:56728/solr ready
   [junit4]   2> 486759 INFO  (qtp7571976-3979) [n:127.0.0.1:56735_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:56735_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 486765 INFO  (OverseerThreadFactory-1527-thread-1-processing-n:127.0.0.1:56735_) [n:127.0.0.1:56735_    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 486876 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 486877 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 486986 INFO  (zkCallback-953-thread-1-processing-n:127.0.0.1:56735_) [n:127.0.0.1:56735_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 487907 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 487925 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 488016 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 488044 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 488045 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 488045 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 488045 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\control-001\cores\control_collection_shard1_replica_n1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\control-001\cores\control_collection_shard1_replica_n1\data\]
   [junit4]   2> 488055 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=54.1708984375, floorSegmentMB=0.583984375, forceMergeDeletesPctAllowed=22.408882066056204, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4496431413688594
   [junit4]   2> 488064 WARN  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 488172 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 488172 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 488173 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
   [junit4]   2> 488173 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 488175 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1c4753a
   [junit4]   2> 488177 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3fbd2a[control_collection_shard1_replica_n1] main]
   [junit4]   2> 488179 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 488179 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 488180 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 488188 INFO  (searcherExecutor-1530-thread-1-processing-n:127.0.0.1:56735_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@3fbd2a[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 488188 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586147576592203776
   [junit4]   2> 488196 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 488196 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 488196 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:56735/control_collection_shard1_replica_n1/
   [junit4]   2> 488196 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 488196 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:56735/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 488197 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 488202 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:56735/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 488307 INFO  (zkCallback-953-thread-2-processing-n:127.0.0.1:56735_) [n:127.0.0.1:56735_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 488354 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 488358 INFO  (qtp7571976-3982) [n:127.0.0.1:56735_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1482
   [junit4]   2> 488362 INFO  (qtp7571976-3979) [n:127.0.0.1:56735_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 488458 INFO  (zkCallback-953-thread-1-processing-n:127.0.0.1:56735_) [n:127.0.0.1:56735_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 488767 INFO  (OverseerCollectionConfigSetProcessor-99134223360786436-127.0.0.1:56735_-n_0000000000) [n:127.0.0.1:56735_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 489363 INFO  (qtp7571976-3979) [n:127.0.0.1:56735_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:56735_&wt=javabin&version=2} status=0 QTime=2604
   [junit4]   2> 489365 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160320d08810005, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 489378 INFO  (zkConnectionManagerCallback-964-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 489381 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 489383 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:56728/solr ready
   [junit4]   2> 489383 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 489385 INFO  (qtp7571976-3983) [n:127.0.0.1:56735_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 489388 INFO  (OverseerThreadFactory-1527-thread-2-processing-n:127.0.0.1:56735_) [n:127.0.0.1:56735_    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 489389 WARN  (OverseerThreadFactory-1527-thread-2-processing-n:127.0.0.1:56735_) [n:127.0.0.1:56735_    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 489596 INFO  (qtp7571976-3983) [n:127.0.0.1:56735_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 489596 INFO  (qtp7571976-3983) [n:127.0.0.1:56735_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=212
   [junit4]   2> 490099 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-1-001 of type TLOG
   [junit4]   2> 490100 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 490101 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1d835d{/,null,AVAILABLE}
   [junit4]   2> 490101 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1af4860{HTTP/1.1,[http/1.1]}{127.0.0.1:56756}
   [junit4]   2> 490101 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.Server Started @497283ms
   [junit4]   2> 490101 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=56756, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-1-001\cores}
   [junit4]   2> 490102 ERROR (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 490102 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 490102 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 490102 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 490102 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-07T17:36:47.740Z
   [junit4]   2> 490106 INFO  (zkConnectionManagerCallback-966-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 490108 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160320d08810007, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 490108 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 490109 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-1-001\solr.xml
   [junit4]   2> 490121 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 490121 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 490124 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 490129 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56728/solr
   [junit4]   2> 490131 INFO  (zkConnectionManagerCallback-970-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 490136 INFO  (zkConnectionManagerCallback-972-thread-1-processing-n:127.0.0.1:56756_) [n:127.0.0.1:56756_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 490144 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56756_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 490147 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56756_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 490149 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56756_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56756_
   [junit4]   2> 490149 INFO  (zkCallback-963-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 490149 INFO  (zkCallback-953-thread-1-processing-n:127.0.0.1:56735_) [n:127.0.0.1:56735_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 490149 INFO  (zkCallback-971-thread-1-processing-n:127.0.0.1:56756_) [n:127.0.0.1:56756_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 490309 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56756_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 490319 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56756_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 490319 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56756_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 490323 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56756_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-1-001\cores
   [junit4]   2> 490359 INFO  (qtp7571976-3985) [n:127.0.0.1:56735_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:56756_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 490362 INFO  (OverseerCollectionConfigSetProcessor-99134223360786436-127.0.0.1:56735_-n_0000000000) [n:127.0.0.1:56735_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 490363 INFO  (OverseerThreadFactory-1527-thread-3-processing-n:127.0.0.1:56735_) [n:127.0.0.1:56735_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:56756_ for creating new replica
   [junit4]   2> 490368 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 490369 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 491408 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 491448 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.IndexSchema [collection1_shard1_replica_t21] Schema name=test
   [junit4]   2> 491552 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 491578 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t21' using configuration from collection collection1, trusted=true
   [junit4]   2> 491579 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t21' (registry 'solr.core.collection1.shard1.replica_t21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 491579 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 491579 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrCore [[collection1_shard1_replica_t21] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-1-001\cores\collection1_shard1_replica_t21], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-1-001\cores\collection1_shard1_replica_t21\data\]
   [junit4]   2> 491587 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=54.1708984375, floorSegmentMB=0.583984375, forceMergeDeletesPctAllowed=22.408882066056204, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4496431413688594
   [junit4]   2> 491594 WARN  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 491702 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 491702 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 491704 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
   [junit4]   2> 491704 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 491706 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@ee700e
   [junit4]   2> 491707 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.SolrIndexSearcher Opening [Searcher@1eade9a[collection1_shard1_replica_t21] main]
   [junit4]   2> 491708 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 491708 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 491710 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 491711 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586147580286337024
   [junit4]   2> 491713 INFO  (searcherExecutor-1541-thread-1-processing-n:127.0.0.1:56756_ x:collection1_shard1_replica_t21 s:shard1 c:collection1) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrCore [collection1_shard1_replica_t21] Registered new searcher Searcher@1eade9a[collection1_shard1_replica_t21] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 491717 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 491717 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 491717 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:56756/collection1_shard1_replica_t21/
   [junit4]   2> 491717 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 491717 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy http://127.0.0.1:56756/collection1_shard1_replica_t21/ has no replicas
   [junit4]   2> 491717 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 491717 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ZkController collection1_shard1_replica_t21 stopping background replication from leader
   [junit4]   2> 491722 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:56756/collection1_shard1_replica_t21/ shard1
   [junit4]   2> 491826 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 491829 INFO  (qtp10920823-4039) [n:127.0.0.1:56756_ c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1461
   [junit4]   2> 491834 INFO  (qtp7571976-3985) [n:127.0.0.1:56735_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:56756_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1474
   [junit4]   2> 492373 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-2-001 of type TLOG
   [junit4]   2> 492374 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 492375 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1058252{/,null,AVAILABLE}
   [junit4]   2> 492376 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@137e108{HTTP/1.1,[http/1.1]}{127.0.0.1:56849}
   [junit4]   2> 492376 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.e.j.s.Server Started @499558ms
   [junit4]   2> 492376 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=56849, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-2-001\cores}
   [junit4]   2> 492377 ERROR (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 492393 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 492394 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 492394 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 492394 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-07T17:36:50.032Z
   [junit4]   2> 492403 INFO  (OverseerCollectionConfigSetProcessor-99134223360786436-127.0.0.1:56735_-n_0000000000) [n:127.0.0.1:56735_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 492406 INFO  (zkConnectionManagerCallback-975-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 492417 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 492417 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-2-001\solr.xml
   [junit4]   2> 492431 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 492431 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 492432 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 492444 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56728/solr
   [junit4]   2> 492447 INFO  (zkConnectionManagerCallback-979-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 492451 INFO  (zkConnectionManagerCallback-981-thread-1-processing-n:127.0.0.1:56849_) [n:127.0.0.1:56849_    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 492461 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56849_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 492464 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56849_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 492467 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56849_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56849_
   [junit4]   2> 492469 INFO  (zkCallback-971-thread-1-processing-n:127.0.0.1:56756_) [n:127.0.0.1:56756_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 492469 INFO  (zkCallback-963-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 492469 INFO  (zkCallback-953-thread-1-processing-n:127.0.0.1:56735_) [n:127.0.0.1:56735_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 492470 INFO  (zkCallback-980-thread-1-processing-n:127.0.0.1:56849_) [n:127.0.0.1:56849_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 492629 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56849_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 492647 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56849_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 492648 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56849_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 492651 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]) [n:127.0.0.1:56849_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-2-001\cores
   [junit4]   2> 492700 INFO  (qtp7571976-3986) [n:127.0.0.1:56735_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:56849_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 492704 INFO  (OverseerThreadFactory-1527-thread-4-processing-n:127.0.0.1:56735_) [n:127.0.0.1:56735_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:56849_ for creating new replica
   [junit4]   2> 492709 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t23&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 492710 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 493758 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 493780 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.s.IndexSchema [collection1_shard1_replica_t23] Schema name=test
   [junit4]   2> 493876 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 493913 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t23' using configuration from collection collection1, trusted=true
   [junit4]   2> 493914 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t23' (registry 'solr.core.collection1.shard1.replica_t23') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18d00e2
   [junit4]   2> 493914 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 493914 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.SolrCore [[collection1_shard1_replica_t23] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-2-001\cores\collection1_shard1_replica_t23], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_692993E6D86F4A55-001\shard-2-001\cores\collection1_shard1_replica_t23\data\]
   [junit4]   2> 493926 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=54.1708984375, floorSegmentMB=0.583984375, forceMergeDeletesPctAllowed=22.408882066056204, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4496431413688594
   [junit4]   2> 493933 WARN  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 494056 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 494057 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 494058 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
   [junit4]   2> 494058 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 494068 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@42c300
   [junit4]   2> 494069 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.s.SolrIndexSearcher Opening [Searcher@167cead[collection1_shard1_replica_t23] main]
   [junit4]   2> 494070 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 494070 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 494071 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 494071 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586147582760976384
   [junit4]   2> 494073 INFO  (searcherExecutor-1552-thread-1-processing-n:127.0.0.1:56849_ x:collection1_shard1_replica_t23 s:shard1 c:collection1) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.SolrCore [collection1_shard1_replica_t23] Registered new searcher Searcher@167cead[collection1_shard1_replica_t23] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 494076 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_t23
   [junit4]   2> 494079 INFO  (qtp15592784-4065) [n:127.0.0.1:56849_ c:collection1 s:shard1  x:collection1_shard1_replica_t23] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t23&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1370
   [junit4]   2> 494082 INFO  (qtp7571976-3986) [n:127.0.0.1:56735_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:56849_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1382
   [junit4]   2> 494128 INFO  (updateExecutor-976-thread-1-processing-n:127.0.0.1:56849_ x:collection1_shard1_replica_t23 s:shard1 c:collection1) [n:127.0.0.1:56849_ c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 494173 INFO  (recoveryExecutor-977-thread-1-processing-n:127.0.0.1:56849_ x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:56849_ c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 494174 INFO  (recoveryExecutor-977-thread-1-processing-n:127.0.0.1:56849_ x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:56849_ c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_t23] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 494174 INFO  (recoveryExecutor-977-thread-1-processing-n:127.0.0.1:56849_ x:collection1_shard1_replica_t23 s:shard1 c:collection1 r:core_

[...truncated too long message...]

 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    5) Thread[id=4187, name=zkCallback-963-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    6) Thread[id=4023, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]-SendThread(127.0.0.1:56728), state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
   [junit4]    >         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   [junit4]    >         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
   [junit4]    >    7) Thread[id=4022, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    8) Thread[id=4027, name=zkCallback-963-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    > at __randomizedtesting.SeedInfo.seed([692993E6D86F4A55]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=4153, name=zkCallback-963-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    2) Thread[id=4177, name=zkCallback-963-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    3) Thread[id=4025, name=zkConnectionManagerCallback-964-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    4) Thread[id=4187, name=zkCallback-963-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    5) Thread[id=4023, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[692993E6D86F4A55]-SendThread(127.0.0.1:56728), state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
   [junit4]    >         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   [junit4]    >         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
   [junit4]    >    6) Thread[id=4027, name=zkCallback-963-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    > at __randomizedtesting.SeedInfo.seed([692993E6D86F4A55]:0)
   [junit4] Completed [111/751 (1!)] on J0 in 73.65s, 1 test, 3 errors <<< FAILURES!

[...truncated 45223 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.2-Windows (64bit/jdk-9.0.1) - Build # 6 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.2-Windows/6/
Java: 64bit/jdk-9.0.1 -XX:+UseCompressedOops -XX:+UseG1GC

8 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.lucene.index.TestBackwardsCompatibility

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J1\temp\lucene.index.TestBackwardsCompatibility_E116A0ADA16C2345-001\4.0.0.2-cfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J1\temp\lucene.index.TestBackwardsCompatibility_E116A0ADA16C2345-001\4.0.0.2-cfs-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J1\temp\lucene.index.TestBackwardsCompatibility_E116A0ADA16C2345-001\4.0.0.2-cfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J1\temp\lucene.index.TestBackwardsCompatibility_E116A0ADA16C2345-001\4.0.0.2-cfs-001

        at __randomizedtesting.SeedInfo.seed([E116A0ADA16C2345]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.lucene.codecs.lucene50.TestLucene60FieldInfoFormat

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001\justSoYouGetSomeChannelErrors-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001\justSoYouGetSomeChannelErrors-001    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001\justSoYouGetSomeChannelErrors-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001\justSoYouGetSomeChannelErrors-001
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001

        at __randomizedtesting.SeedInfo.seed([500FECA5C0BAB3AA]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.ltr.TestLTRQParserExplain

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\contrib\solr-ltr\test\J1\temp\solr.ltr.TestLTRQParserExplain_E95BE43AD84DD2C-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\contrib\solr-ltr\test\J1\temp\solr.ltr.TestLTRQParserExplain_E95BE43AD84DD2C-001\init-core-data-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\contrib\solr-ltr\test\J1\temp\solr.ltr.TestLTRQParserExplain_E95BE43AD84DD2C-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\contrib\solr-ltr\test\J1\temp\solr.ltr.TestLTRQParserExplain_E95BE43AD84DD2C-001\init-core-data-001

        at __randomizedtesting.SeedInfo.seed([E95BE43AD84DD2C]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.analysis.PathHierarchyTokenizerFactoryTest

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001\init-core-data-001    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001\init-core-data-001\spellcheckerFQCN: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001\init-core-data-001\spellcheckerFQCN    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001\init-core-data-001
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001\init-core-data-001\spellcheckerFQCN: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001\init-core-data-001\spellcheckerFQCN
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.analysis.PathHierarchyTokenizerFactoryTest_F6A32DF155853569-001

        at __randomizedtesting.SeedInfo.seed([F6A32DF155853569]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestZkChroot

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.TestZkChroot_F6A32DF155853569-001\tempDir-003\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.TestZkChroot_F6A32DF155853569-001\tempDir-003\collection1    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.TestZkChroot_F6A32DF155853569-001\tempDir-003: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.TestZkChroot_F6A32DF155853569-001\tempDir-003

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.TestZkChroot_F6A32DF155853569-001\tempDir-003\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.TestZkChroot_F6A32DF155853569-001\tempDir-003\collection1
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.TestZkChroot_F6A32DF155853569-001\tempDir-003: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.TestZkChroot_F6A32DF155853569-001\tempDir-003

        at __randomizedtesting.SeedInfo.seed([F6A32DF155853569]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestBlobHandler

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1\data\tlog: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1\data\tlog    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1\data: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1\data    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1\data\tlog: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1\data\tlog
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1\data: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1\data
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores\.system_shard1_replica_n1
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001\cores
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\shard-4-001

        at __randomizedtesting.SeedInfo.seed([F6A32DF155853569]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.rest.schema.TestCopyFieldCollectionResource

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core\data: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core\data    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core\data: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core\data
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003

        at __randomizedtesting.SeedInfo.seed([F6A32DF155853569]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.response.TestSpellCheckResponse

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001\tlog: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001\tlog    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001\tlog\tlog.0000000000000000002: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001\tlog\tlog.0000000000000000002    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001\tlog: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001\tlog
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001\tlog\tlog.0000000000000000002: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001\init-core-data-001\tlog\tlog.0000000000000000002
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.response.TestSpellCheckResponse_35D5BBF829CB8868-001

        at __randomizedtesting.SeedInfo.seed([35D5BBF829CB8868]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 478 lines...]
   [junit4] Suite: org.apache.lucene.codecs.lucene50.TestLucene60FieldInfoFormat
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=149, maxMBSortInHeap=5.41610152062096, sim=RandomSimilarity(queryNorm=false): {}, locale=cs-CZ, timezone=America/Cayman
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=187404184,total=218103808
   [junit4]   2> NOTE: All tests run in this JVM: [TestCachingCollector, TestNoMergeScheduler, TestFieldType, TestOmitNorms, TestDocValuesQueries, TestLogMergePolicy, TestOperations, TestIndexedDISI, TestIndexWriterOnJRECrash, TestBlendedTermQuery, TestSubScorerFreqs, TestMultiPhraseQuery, TestCharTermAttributeImpl, TestNearSpansOrdered, TestGraphTokenizers, TestTransactions, TestSpanTermQuery, TestBooleanScorer, TestDirectMonotonic, TestDirectory, TestOrdinalMap, TestByteBlockPool, TestRoaringDocIdSet, TestMultiDocValues, TestElevationComparator, TestByteSlices, TestUpgradeIndexMergePolicy, TestGrowableByteArrayDataOutput, TestPostingsOffsets, TestSpanBoostQuery, TestFieldMaskingSpanQuery, TestDeletionPolicy, TestStringMSBRadixSorter, TestBoolean2, TestSortedSetSortField, TestCustomSearcherSort, TestTransactionRollback, TestExitableDirectoryReader, TestDelegatingAnalyzerWrapper, TestParallelTermEnum, TestLucene60FieldInfoFormat]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLucene60FieldInfoFormat -Dtests.seed=500FECA5C0BAB3AA -Dtests.slow=true -Dtests.locale=cs-CZ -Dtests.timezone=America/Cayman -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestLucene60FieldInfoFormat (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001\justSoYouGetSomeChannelErrors-001: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001\justSoYouGetSomeChannelErrors-001
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J1\temp\lucene.codecs.lucene50.TestLucene60FieldInfoFormat_500FECA5C0BAB3AA-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([500FECA5C0BAB3AA]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [77/458 (1!)] on J1 in 1.86s, 11 tests, 1 error <<< FAILURES!

[...truncated 4123 lines...]
   [junit4] Suite: org.apache.lucene.index.TestBackwardsCompatibility
   [junit4] IGNOR/A 0.00s J1 | TestBackwardsCompatibility.testCreateIndexWithDocValuesUpdates
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J1 | TestBackwardsCompatibility.testCreateMoreTermsIndex
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J1 | TestBackwardsCompatibility.testCreateNoCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.01s J1 | TestBackwardsCompatibility.testCreateCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J1 | TestBackwardsCompatibility.testCreateEmptyIndex
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J1 | TestBackwardsCompatibility.testCreateSingleSegmentNoCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J1 | TestBackwardsCompatibility.testCreateSingleSegmentCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J1 | TestBackwardsCompatibility.testCreateSortedIndex
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=true): {content6=DFR I(F)1, content5=DFR I(F)LZ(0.3), content2=DFR GB3(800.0), utf8=DFR GZ(0.3), fie?ld=DFR GLZ(0.3), content=DFR I(F)L2, autf8=DFR G1}, locale=rm-CH, timezone=Eire
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=72625000,total=159383552
   [junit4]   2> NOTE: All tests run in this JVM: [TestLucene53NormsFormat, TestLucene62SegmentInfoFormat, TestBackwardsCompatibility]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestBackwardsCompatibility -Dtests.seed=E116A0ADA16C2345 -Dtests.slow=true -Dtests.locale=rm-CH -Dtests.timezone=Eire -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | TestBackwardsCompatibility (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J1\temp\lucene.index.TestBackwardsCompatibility_E116A0ADA16C2345-001\4.0.0.2-cfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J1\temp\lucene.index.TestBackwardsCompatibility_E116A0ADA16C2345-001\4.0.0.2-cfs-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([E116A0ADA16C2345]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [5/8 (1!)] on J1 in 40.88s, 30 tests, 1 error, 8 skipped <<< FAILURES!

[...truncated 7123 lines...]
   [junit4] Suite: org.apache.solr.rest.schema.TestCopyFieldCollectionResource
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\init-core-data-001
   [junit4]   2> 190278 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 190281 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 190281 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 190285 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-001\cores\core
   [junit4]   2> 190291 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 190291 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 190292 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core
   [junit4]   2> 190296 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 190297 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@57a5174b{/solr,null,AVAILABLE}
   [junit4]   2> 190299 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1c54daec{HTTP/1.1,[http/1.1]}{127.0.0.1:52865}
   [junit4]   2> 190300 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.e.j.s.Server Started @200643ms
   [junit4]   2> 190300 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, configSetBaseDir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr, hostPort=52865, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores}
   [junit4]   2> 190301 ERROR (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 190301 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 190301 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 190301 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 190301 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-08T02:29:50.276189900Z
   [junit4]   2> 190301 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\solr.xml
   [junit4]   2> 190307 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 190307 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 190308 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@72352ebf, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 190395 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@72352ebf
   [junit4]   2> 190410 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@72352ebf
   [junit4]   2> 190410 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@72352ebf
   [junit4]   2> 190414 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores
   [junit4]   2> 190414 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 190415 INFO  (coreLoadExecutor-1575-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 190421 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 190476 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 190521 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test-rest
   [junit4]   2> 190694 WARN  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.ManagedSynonymFilterFactory]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 190787 WARN  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.s.IndexSchema Field title is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 190787 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test-rest/1.6 with uniqueid field id
   [junit4]   2> 190818 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Registered ManagedResource impl org.apache.solr.rest.schema.analysis.ManagedWordSetResource for path /schema/analysis/stopwords/english
   [junit4]   2> 190819 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Registered ManagedResource impl org.apache.solr.rest.schema.analysis.ManagedSynonymFilterFactory$SynonymManager for path /schema/analysis/synonyms/english
   [junit4]   2> 190819 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Registered ManagedResource impl org.apache.solr.rest.schema.analysis.ManagedWordSetResource for path /schema/analysis/stopwords/german
   [junit4]   2> 190819 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Registered ManagedResource impl org.apache.solr.rest.schema.analysis.ManagedSynonymFilterFactory$SynonymManager for path /schema/analysis/synonyms/german
   [junit4]   2> 190819 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Added observer of type org.apache.solr.rest.schema.analysis.ManagedStopFilterFactory to existing ManagedResource /schema/analysis/stopwords/english
   [junit4]   2> 190821 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Registered ManagedResource impl org.apache.solr.rest.schema.analysis.ManagedSynonymGraphFilterFactory$SynonymManager for path /schema/analysis/synonyms/englishgraph
   [junit4]   2> 190821 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Added observer of type org.apache.solr.rest.schema.analysis.ManagedStopFilterFactory to existing ManagedResource /schema/analysis/stopwords/english
   [junit4]   2> 190821 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Added observer of type org.apache.solr.rest.schema.analysis.ManagedSynonymGraphFilterFactory to existing ManagedResource /schema/analysis/synonyms/englishgraph
   [junit4]   2> 190821 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Added observer of type org.apache.solr.rest.schema.analysis.ManagedStopFilterFactory to existing ManagedResource /schema/analysis/stopwords/german
   [junit4]   2> 190821 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Registered ManagedResource impl org.apache.solr.rest.schema.analysis.ManagedSynonymGraphFilterFactory$SynonymManager for path /schema/analysis/synonyms/germangraph
   [junit4]   2> 190821 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Added observer of type org.apache.solr.rest.schema.analysis.ManagedStopFilterFactory to existing ManagedResource /schema/analysis/stopwords/german
   [junit4]   2> 190821 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.RestManager Added observer of type org.apache.solr.rest.schema.analysis.ManagedSynonymGraphFilterFactory to existing ManagedResource /schema/analysis/synonyms/germangraph
   [junit4]   2> 190821 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 190822 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@72352ebf
   [junit4]   2> 190822 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 190822 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core\data\]
   [junit4]   2> 190825 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=84.7705078125, floorSegmentMB=0.70703125, forceMergeDeletesPctAllowed=19.40839473714424, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 190975 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 190975 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 191042 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 191042 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 191044 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=10, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 191047 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@292770a[collection1] main]
   [junit4]   2> 191049 WARN  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource No stored data found for /schema/analysis/stopwords/english
   [junit4]   2> 191050 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Saved JSON object to path _schema_analysis_stopwords_english.json using InMemoryStorage
   [junit4]   2> 191050 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.s.a.ManagedWordSetResource Loaded 0 words for /schema/analysis/stopwords/english
   [junit4]   2> 191050 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource Notified 3 observers of /schema/analysis/stopwords/english
   [junit4]   2> 191050 WARN  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource No stored data found for /schema/analysis/stopwords/german
   [junit4]   2> 191050 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Saved JSON object to path _schema_analysis_stopwords_german.json using InMemoryStorage
   [junit4]   2> 191050 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.s.a.ManagedWordSetResource Loaded 0 words for /schema/analysis/stopwords/german
   [junit4]   2> 191050 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource Notified 3 observers of /schema/analysis/stopwords/german
   [junit4]   2> 191051 WARN  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource No stored data found for /schema/analysis/synonyms/english
   [junit4]   2> 191051 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.s.a.ManagedSynonymFilterFactory Loaded 0 synonym mappings for /schema/analysis/synonyms/english
   [junit4]   2> 191061 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource Notified 1 observers of /schema/analysis/synonyms/english
   [junit4]   2> 191061 WARN  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource No stored data found for /schema/analysis/synonyms/englishgraph
   [junit4]   2> 191062 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.s.a.ManagedSynonymGraphFilterFactory Loaded 0 synonym mappings for /schema/analysis/synonyms/englishgraph
   [junit4]   2> 191064 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource Notified 2 observers of /schema/analysis/synonyms/englishgraph
   [junit4]   2> 191064 WARN  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource No stored data found for /schema/analysis/synonyms/german
   [junit4]   2> 191064 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.s.a.ManagedSynonymFilterFactory Loaded 0 synonym mappings for /schema/analysis/synonyms/german
   [junit4]   2> 191064 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource Notified 1 observers of /schema/analysis/synonyms/german
   [junit4]   2> 191064 WARN  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource No stored data found for /schema/analysis/synonyms/germangraph
   [junit4]   2> 191064 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.s.a.ManagedSynonymGraphFilterFactory Loaded 0 synonym mappings for /schema/analysis/synonyms/germangraph
   [junit4]   2> 191064 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.r.ManagedResource Notified 2 observers of /schema/analysis/synonyms/germangraph
   [junit4]   2> 191065 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 191136 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 191217 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 191217 INFO  (searcherExecutor-1576-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 191217 INFO  (coreLoadExecutor-1575-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586181115679342592
   [junit4]   2> 191218 INFO  (searcherExecutor-1576-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 191218 INFO  (searcherExecutor-1576-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 191218 INFO  (searcherExecutor-1576-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 191219 INFO  (searcherExecutor-1576-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 191219 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrJettyTestBase Jetty Assigned Port#52865
   [junit4]   2> 191220 INFO  (searcherExecutor-1576-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 191221 INFO  (searcherExecutor-1576-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 191221 INFO  (searcherExecutor-1576-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 191223 INFO  (searcherExecutor-1576-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 191226 INFO  (searcherExecutor-1576-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@292770a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 191229 INFO  (TEST-TestCopyFieldCollectionResource.testGetAllCopyFields-seed#[F6A32DF155853569]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testGetAllCopyFields
   [junit4]   2> 191233 INFO  (qtp933782442-3137) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema/copyfields params={indent=on&wt=json} status=0 QTime=2
   [junit4]   2> 191238 INFO  (TEST-TestCopyFieldCollectionResource.testGetAllCopyFields-seed#[F6A32DF155853569]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testGetAllCopyFields
   [junit4]   2> 191246 INFO  (TEST-TestCopyFieldCollectionResource.testRestrictSource-seed#[F6A32DF155853569]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testRestrictSource
   [junit4]   2> 191249 INFO  (qtp933782442-3138) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema/copyfields params={indent=on&source.fl=title,*_i,*_src_sub_i,src_sub_no_ast_i&wt=xml} status=0 QTime=2
   [junit4]   2> 191256 INFO  (TEST-TestCopyFieldCollectionResource.testRestrictSource-seed#[F6A32DF155853569]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testRestrictSource
   [junit4]   2> 191264 INFO  (TEST-TestCopyFieldCollectionResource.testXMLGetAllCopyFields-seed#[F6A32DF155853569]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testXMLGetAllCopyFields
   [junit4]   2> 191265 INFO  (qtp933782442-3138) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema/copyfields params={indent=on&wt=xml} status=0 QTime=0
   [junit4]   2> 191272 INFO  (TEST-TestCopyFieldCollectionResource.testXMLGetAllCopyFields-seed#[F6A32DF155853569]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testXMLGetAllCopyFields
   [junit4]   2> 191278 INFO  (TEST-TestCopyFieldCollectionResource.testRestrictDest-seed#[F6A32DF155853569]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testRestrictDest
   [junit4]   2> 191279 INFO  (qtp933782442-3136) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema/copyfields params={dest.fl=title,*_s,*_dest_sub_s,dest_sub_no_ast_s&indent=on&wt=xml} status=0 QTime=0
   [junit4]   2> 191280 INFO  (TEST-TestCopyFieldCollectionResource.testRestrictDest-seed#[F6A32DF155853569]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testRestrictDest
   [junit4]   2> 191288 INFO  (TEST-TestCopyFieldCollectionResource.testRestrictSourceAndDest-seed#[F6A32DF155853569]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testRestrictSourceAndDest
   [junit4]   2> 191289 INFO  (qtp933782442-3142) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema/copyfields params={dest.fl=title,dest_sub_no_ast_s&indent=on&source.fl=title,*_i&wt=xml} status=0 QTime=0
   [junit4]   2> 191291 INFO  (TEST-TestCopyFieldCollectionResource.testRestrictSourceAndDest-seed#[F6A32DF155853569]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testRestrictSourceAndDest
   [junit4]   2> 191295 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1c54daec{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 191295 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=831242359
   [junit4]   2> 191295 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 191295 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@31c4ba99: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@46a51d2c
   [junit4]   2> 191304 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 191304 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1b44e96a: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@873d83a
   [junit4]   2> 191310 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 191311 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@70dd10e1: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2e4c9443
   [junit4]   2> 191311 INFO  (coreCloseExecutor-1581-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@201fb9ee
   [junit4]   2> 191312 INFO  (coreCloseExecutor-1581-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=538950126
   [junit4]   2> 191312 INFO  (coreCloseExecutor-1581-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1b180545: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@3804710
   [junit4]   2> 191340 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@57a5174b{/solr,null,UNAVAILABLE}
   [junit4]   2> 191341 INFO  (SUITE-TestCopyFieldCollectionResource-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=607, maxMBSortInHeap=5.698998768729098, sim=RandomSimilarity(queryNorm=true): {}, locale=kam, timezone=SystemV/CST6
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=78016464,total=444596224
   [junit4]   2> NOTE: All tests run in this JVM: [SegmentsInfoRequestHandlerTest, TriLevelCompositeIdRoutingTest, TestRequestForwarding, ShardRoutingCustomTest, TestConfigsApi, TestShardHandlerFactory, CoreAdminRequestStatusTest, TestMaxScoreQueryParser, TestMergePolicyConfig, BlockJoinFacetDistribTest, TestAnalyzeInfixSuggestions, ZkNodePropsTest, TestCloudRecovery, OverseerCollectionConfigSetProcessorTest, OpenExchangeRatesOrgProviderTest, HttpSolrCallGetCoreTest, SolrIndexMetricsTest, SynonymTokenizerTest, TestUtilizeNode, TestComponentsName, SolrCloudExampleTest, UtilsToolTest, TestLuceneIndexBackCompat, SmileWriterTest, TestSolrCloudWithHadoopAuthPlugin, TestBM25SimilarityFactory, TestSolrConfigHandlerConcurrent, TestGroupingSearch, SolrMetricsIntegrationTest, DocValuesMultiTest, TestChildDocTransformer, TestExactSharedStatsCache, AnalysisErrorHandlingTest, TestClusterStateMutator, TestCopyFieldCollectionResource]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCopyFieldCollectionResource -Dtests.seed=F6A32DF155853569 -Dtests.slow=true -Dtests.locale=kam -Dtests.timezone=SystemV/CST6 -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | TestCopyFieldCollectionResource (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core\data: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core\data
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores\core
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003\cores
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.rest.schema.TestCopyFieldCollectionResource_F6A32DF155853569-001\tempDir-003
   [junit4]    > at __randomizedtesting.SeedInfo.seed([F6A32DF155853569]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [55/751 (1!)] on J1 in 1.12s, 5 tests, 1 error <<< FAILURES!

[...truncated 689 lines...]
   [junit4] Suite: org.apache.solr.handler.TestBlobHandler
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\init-core-data-001
   [junit4]   2> 1397323 WARN  (SUITE-TestBlobHandler-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> 1397323 INFO  (SUITE-TestBlobHandler-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1397328 INFO  (SUITE-TestBlobHandler-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 1397328 INFO  (SUITE-TestBlobHandler-seed#[F6A32DF155853569]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1397329 INFO  (SUITE-TestBlobHandler-seed#[F6A32DF155853569]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /mz/
   [junit4]   2> 1397352 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1397353 INFO  (Thread-2137) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1397353 INFO  (Thread-2137) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1397365 ERROR (Thread-2137) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1397453 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.ZkTestServer start zk server on port:61160
   [junit4]   2> 1397461 INFO  (zkConnectionManagerCallback-2443-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1397478 INFO  (zkConnectionManagerCallback-2445-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1397485 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1397489 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1397491 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1397494 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1397495 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1397497 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1397499 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1397501 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1397503 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1397504 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1397506 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1397509 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 1398177 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1398178 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3785accf{/mz,null,AVAILABLE}
   [junit4]   2> 1398185 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5f792b3c{HTTP/1.1,[http/1.1]}{127.0.0.1:61167}
   [junit4]   2> 1398185 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.e.j.s.Server Started @1408529ms
   [junit4]   2> 1398185 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/mz, solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\tempDir-001/control/data, hostPort=61167, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\control-001\cores, replicaType=NRT}
   [junit4]   2> 1398186 ERROR (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1398186 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 1398186 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1398186 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1398186 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-08T02:49:58.161825900Z
   [junit4]   2> 1398189 INFO  (zkConnectionManagerCallback-2447-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1398191 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160340789550002, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1398191 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1398191 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\control-001\solr.xml
   [junit4]   2> 1398197 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1398197 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1398198 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@72352ebf, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 1398204 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61160/solr
   [junit4]   2> 1398207 INFO  (zkConnectionManagerCallback-2451-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1398209 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160340789550003, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1398211 INFO  (zkConnectionManagerCallback-2453-thread-1-processing-n:127.0.0.1:61167_mz) [n:127.0.0.1:61167_mz    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1398414 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [n:127.0.0.1:61167_mz    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1398416 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [n:127.0.0.1:61167_mz    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:61167_mz
   [junit4]   2> 1398416 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [n:127.0.0.1:61167_mz    ] o.a.s.c.Overseer Overseer (id=99136398775615492-127.0.0.1:61167_mz-n_0000000000) starting
   [junit4]   2> 1398427 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [n:127.0.0.1:61167_mz    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61167_mz
   [junit4]   2> 1398540 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [n:127.0.0.1:61167_mz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@72352ebf
   [junit4]   2> 1398554 INFO  (OverseerStateUpdate-99136398775615492-127.0.0.1:61167_mz-n_0000000000) [n:127.0.0.1:61167_mz    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1398557 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [n:127.0.0.1:61167_mz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@72352ebf
   [junit4]   2> 1398557 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [n:127.0.0.1:61167_mz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@72352ebf
   [junit4]   2> 1398560 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [n:127.0.0.1:61167_mz    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\control-001\cores
   [junit4]   2> 1398614 INFO  (zkConnectionManagerCallback-2459-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1398619 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1398621 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[F6A32DF155853569]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:61160/solr ready
   [junit4]   2> 1398624 INFO  (qtp718581671-13108) [n:127.0.0.1:61167_mz    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:61167_mz&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1398629 INFO  (OverseerThreadFactory-4918-thread-1-processing-n:127.0.0.1:61167_mz) [n:127.0.0.1:61167_mz    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 1398746 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1398747 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 1398857 INFO  (zkCallback-2452-thread-1-processing-n:127.0.0.1:61167_mz) [n:127.0.0.1:61167_mz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1399790 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1399820 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 1399934 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1399959 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 1399960 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@72352ebf
   [junit4]   2> 1399960 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1399960 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\control-001\cores\control_collection_shard1_replica_n1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.TestBlobHandler_F6A32DF155853569-001\control-001\cores\control_collection_shard1_replica_n1\data\]
   [junit4]   2> 1399963 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=42, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.10317760755302113]
   [junit4]   2> 1399967 WARN  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1400059 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1400059 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1400059 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1400064 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1400065 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=21.791015625, floorSegmentMB=1.55078125, forceMergeDeletesPctAllowed=25.038517524073818, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.49680156268920983
   [junit4]   2> 1400066 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@c5d7d67[control_collection_shard1_replica_n1] main]
   [junit4]   2> 1400067 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1400068 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1400069 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1400070 INFO  (searcherExecutor-4919-thread-1-processing-n:127.0.0.1:61167_mz x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@c5d7d67[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1400070 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586182383253585920
   [junit4]   2> 1400101 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1400101 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1400101 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:61167/mz/control_collection_shard1_replica_n1/
   [junit4]   2> 1400101 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1400101 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:61167/mz/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 1400101 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1400107 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:61167/mz/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 1400212 INFO  (zkCallback-2452-thread-1-processing-n:127.0.0.1:61167_mz) [n:127.0.0.1:61167_mz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1400262 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1400266 INFO  (qtp718581671-13105) [n:127.0.0.1:61167_mz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1519
   [junit4]   2> 1400269 INFO  (qtp718581671-13108) [n:127.0.0.1:61167_mz    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1400368 INFO  (zkCallback-2452-thread-2-processing-n:127.0.0.1:61167_mz) [n:127.0.0.1:61167_mz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1400629 INFO  (OverseerCollectionConfigSetProcessor-99136398775615492-127.0.0.1:61167_mz-n_0000000000) [n:127.0.0.1:61167_mz    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1401270 INFO  (qtp718581671-13108) [n:127.0.0.1:61167_mz    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:61167_mz&wt=javabin&version=2} status=0 QTime=2645
   [junit4]   2> 1401277 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x160340789550005, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnx

[...truncated too long message...]

g.LogFilter afterHandle
   [junit4]   2> INFO: ????-??-?? ??:??:?? 127.0.0.1 - 127.0.0.1 55869 PUT /solr/schema/model-store wt=json&indent=on 200 - 271 1 http://127.0.0.1:55869        Apache-HttpClient/4.5.3 (Java/9.0.1) -
   [junit4]   2> 25050 WARN  (qtp1380736033-250) [    x:collection1] o.e.j.s.ServletHandler Error for /solr/collection1/schema/model-store
   [junit4]   2> java.lang.AssertionError: Attempted close of response output stream.
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter$2$1.close(SolrDispatchFilter.java:525)
   [junit4]   2> at org.eclipse.jetty.server.Dispatcher.commitResponse(Dispatcher.java:270)
   [junit4]   2> at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:202)
   [junit4]   2> at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:74)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:391)
   [junit4]   2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 25054 INFO  (qtp1380736033-248) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/query params={q=title:bloomberg&indent=on&fl=*,score&rows=4&wt=json&debugQuery=on&rq={!ltr+reRankDocs%3D4+model%3Dlinear-efi}} hits=4 status=0 QTime=2
   [junit4]   2> 25057 INFO  (qtp1380736033-247) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/query params={q=title:bloomberg&indent=on&fl=*,score&rows=4&wt=json&debugQuery=on&rq={!ltr+reRankDocs%3D4+model%3Dlinear-efi}} hits=4 status=0 QTime=2
   [junit4]   2> 25060 INFO  (TEST-TestLTRQParserExplain.LinearScoreExplainMissingEfiFeatureShouldReturnDefaultScore-seed#[E95BE43AD84DD2C]) [    ] o.a.s.SolrTestCaseJ4 ###Ending LinearScoreExplainMissingEfiFeatureShouldReturnDefaultScore
   [junit4]   2> 25063 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@97a37b4{HTTP/1.1,[http/1.1]}{127.0.0.1:?}
   [junit4]   2> 25063 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2146989401
   [junit4]   2> 25065 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 25065 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 25065 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 25067 INFO  (coreCloseExecutor-153-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3f165b32
   [junit4]   2> 25067 INFO  (coreCloseExecutor-153-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1058429746
   [junit4]   2> 25079 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@675a655b{/solr,null,UNAVAILABLE}
   [junit4]   2> 25085 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 25085 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=498361256
   [junit4]   2> 25085 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 25085 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6a51df6b: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / null
   [junit4]   2> 25085 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 25086 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@cbbca47: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / null
   [junit4]   2> 25086 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 25086 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5d0180cb: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / null
   [junit4]   2> 25086 INFO  (coreCloseExecutor-155-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@a530511
   [junit4]   2> 25086 INFO  (coreCloseExecutor-155-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=173212945
   [junit4]   2> 25086 INFO  (coreCloseExecutor-155-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2253c69c: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / null
   [junit4]   2> 25089 INFO  (SUITE-TestLTRQParserExplain-seed#[E95BE43AD84DD2C]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=true): {}, locale=pa-Arab-PK, timezone=VST
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=54341024,total=118489088
   [junit4]   2> NOTE: All tests run in this JVM: [TestRankingFeature, TestModelManager, TestUserTermScorerQuery, TestFieldLengthFeature, TestLTRReRankingPipeline, TestValueFeature, TestLTRQParserExplain]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLTRQParserExplain -Dtests.seed=E95BE43AD84DD2C -Dtests.slow=true -Dtests.locale=pa-Arab-PK -Dtests.timezone=VST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J1 | TestLTRQParserExplain (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\contrib\solr-ltr\test\J1\temp\solr.ltr.TestLTRQParserExplain_E95BE43AD84DD2C-001\init-core-data-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\contrib\solr-ltr\test\J1\temp\solr.ltr.TestLTRQParserExplain_E95BE43AD84DD2C-001\init-core-data-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([E95BE43AD84DD2C]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [14/35 (1!)] on J1 in 1.12s, 4 tests, 1 error <<< FAILURES!

[...truncated 32906 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.2-Windows (32bit/jdk1.8.0_144) - Build # 7 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.2-Windows/7/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseSerialGC

5 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.lucene.index.TestDemoParallelLeafReader

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.index.TestDemoParallelLeafReader_577D0F7CDEDF8E0F-001\tempDir-005: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.index.TestDemoParallelLeafReader_577D0F7CDEDF8E0F-001\tempDir-005

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.index.TestDemoParallelLeafReader_577D0F7CDEDF8E0F-001\tempDir-005: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.index.TestDemoParallelLeafReader_577D0F7CDEDF8E0F-001\tempDir-005

        at __randomizedtesting.SeedInfo.seed([577D0F7CDEDF8E0F]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.lucene.replicator.IndexReplicationClientTest.testConsistencyOnExceptions

Error Message:
Captured an uncaught exception in thread: Thread[id=23, name=ReplicationThread-index, state=RUNNABLE, group=TGRP-IndexReplicationClientTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=23, name=ReplicationThread-index, state=RUNNABLE, group=TGRP-IndexReplicationClientTest]
        at __randomizedtesting.SeedInfo.seed([5883E54C91CBFDEB:D70D02EC83A70E14]:0)
Caused by: java.lang.AssertionError: handler failed too many times: -1
        at __randomizedtesting.SeedInfo.seed([5883E54C91CBFDEB]:0)
        at org.apache.lucene.replicator.IndexReplicationClientTest$4.handleUpdateException(IndexReplicationClientTest.java:304)
        at org.apache.lucene.replicator.ReplicationClient$ReplicationThread.run(ReplicationClient.java:77)


FAILED:  junit.framework.TestSuite.org.apache.solr.TestDistributedGrouping

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores\collection1\data: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores\collection1\data    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores\collection1    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores\collection1\data: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores\collection1\data
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores\collection1
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2\cores
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001\shard2
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.TestDistributedGrouping_9EB52C48F87166FE-001\tempDir-001

        at __randomizedtesting.SeedInfo.seed([9EB52C48F87166FE]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.component.DistributedFacetPivotSmallTest

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2\collection1    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2\collection1
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001

        at __randomizedtesting.SeedInfo.seed([9EB52C48F87166FE]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.update.SolrCmdDistributorTest

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default\conf: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default\conf    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default\conf: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default\conf
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001

        at __randomizedtesting.SeedInfo.seed([9EB52C48F87166FE]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 863 lines...]
   [junit4] Suite: org.apache.lucene.index.TestDemoParallelLeafReader
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=LuceneVarGapDocFreqInterval), text=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{number=DocValuesFormat(name=Lucene70), number_2=DocValuesFormat(name=Lucene70), number_1=DocValuesFormat(name=Direct), number_0=DocValuesFormat(name=Memory), text=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=642, maxMBSortInHeap=7.038217902384968, sim=RandomSimilarity(queryNorm=true): {text=DFR I(n)L1}, locale=ga, timezone=Africa/Addis_Ababa
   [junit4]   2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_144 (32-bit)/cpus=3,threads=1,free=71752640,total=230232064
   [junit4]   2> NOTE: All tests run in this JVM: [TestDateSort, TestSnapshotDeletionPolicy, TestReusableStringReader, TestHugeRamFile, TestAxiomaticSimilarity, TestFlushByRamOrCountsPolicy, TestAllFilesDetectTruncation, TestIntBlockPool, TestBooleanOr, TestSumDocFreq, TestRadixSelector, TestBytesRef, TestBinaryDocValuesUpdates, TestCrash, TestMmapDirectory, TestIndexWriterMergePolicy, TestUnicodeUtil, TestTerm, Test2BPoints, TestMathUtil, TestHighCompressionMode, TestFilterDirectory, TestFixedBitDocIdSet, TestFilterSpans, TestIndexWriterExceptions, TestInfoStream, TestForceMergeForever, TestTieredMergePolicy, TestIndexWriterUnicode, TestNamedSPILoader, TestBKD, TestAddIndexes, TestTopDocsCollector, TestSparseFixedBitDocIdSet, TestIOUtils, TestIndexWriterDeleteByQuery, TestCloseableThreadLocal, TestBooleanSimilarity, TestOfflineSorter, TestTerms, TestStandardAnalyzer, TestWordlistLoader, TestSpanExplanations, TestDocInverterPerFieldErrorInfo, TestSearch, TestMultiMMap, TestBooleanQueryVisitSubscorers, TestIndexWriterWithThreads, TestMultiset, TestBooleanQuery, TestLucene60PointsFormat, TestLucene70SegmentInfoFormat, TestAllFilesHaveCodecHeader, TestCustomNorms, TestRegexpQuery, TestSameTokenSamePosition, TestCharacterUtils, TestSpans, TestSimilarity2, TestRamUsageEstimator, TestDocsAndPositions, TestLevenshteinAutomata, TestFilterLeafReader, TestSpansEnum, TestDocumentsWriterDeleteQueue, TestCollectionUtil, TestNormsFieldExistsQuery, TestFilterIterator, TestSort, TestSortRescorer, TestDocument, TestTimSorter, TestNRTReaderCleanup, TestBagOfPositions, TestTrackingDirectoryWrapper, TestPolygon, TestSimpleAttributeImpl, TestDocsWithFieldSet, TestLongRangeFieldQueries, TestControlledRealTimeReopenThread, TestIntArrayDocIdSet, TestMixedCodecs, TestDoubleValuesSource, TestTwoPhaseCommitTool, TestToken, TestPointValues, TestSpanSearchEquivalence, TestCharArrayMap, TestDeterminizeLexicon, TestMutablePointsReaderUtils, TestLucene50TermVectorsFormat, TestUTF32ToUTF8, TestSegmentTermEnum, TestSPIClassIterator, TestDemoParallelLeafReader]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDemoParallelLeafReader -Dtests.seed=577D0F7CDEDF8E0F -Dtests.slow=true -Dtests.locale=ga -Dtests.timezone=Africa/Addis_Ababa -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | TestDemoParallelLeafReader (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.index.TestDemoParallelLeafReader_577D0F7CDEDF8E0F-001\tempDir-005: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.index.TestDemoParallelLeafReader_577D0F7CDEDF8E0F-001\tempDir-005
   [junit4]    > at __randomizedtesting.SeedInfo.seed([577D0F7CDEDF8E0F]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [194/458 (1!)] on J0 in 7.28s, 5 tests, 1 error <<< FAILURES!

[...truncated 7874 lines...]
   [junit4] Suite: org.apache.lucene.replicator.IndexReplicationClientTest
   [junit4]   2> Dec 09, 2017 11:22:30 AM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[ReplicationThread-index,5,TGRP-IndexReplicationClientTest]
   [junit4]   2> java.lang.AssertionError: handler failed too many times: -1
   [junit4]   2> at __randomizedtesting.SeedInfo.seed([5883E54C91CBFDEB]:0)
   [junit4]   2> at org.apache.lucene.replicator.IndexReplicationClientTest$4.handleUpdateException(IndexReplicationClientTest.java:304)
   [junit4]   2> at org.apache.lucene.replicator.ReplicationClient$ReplicationThread.run(ReplicationClient.java:77)
   [junit4]   2>
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=IndexReplicationClientTest -Dtests.method=testConsistencyOnExceptions -Dtests.seed=5883E54C91CBFDEB -Dtests.slow=true -Dtests.locale=en-SG -Dtests.timezone=America/Araguaina -Dtests.asserts=true -Dtests.file.encoding=Cp1252
   [junit4] ERROR   2.06s J1 | IndexReplicationClientTest.testConsistencyOnExceptions <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=23, name=ReplicationThread-index, state=RUNNABLE, group=TGRP-IndexReplicationClientTest]
   [junit4]    > at __randomizedtesting.SeedInfo.seed([5883E54C91CBFDEB:D70D02EC83A70E14]:0)
   [junit4]    > Caused by: java.lang.AssertionError: handler failed too many times: -1
   [junit4]    > at __randomizedtesting.SeedInfo.seed([5883E54C91CBFDEB]:0)
   [junit4]    > at org.apache.lucene.replicator.IndexReplicationClientTest$4.handleUpdateException(IndexReplicationClientTest.java:304)
   [junit4]    > at org.apache.lucene.replicator.ReplicationClient$ReplicationThread.run(ReplicationClient.java:77)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=610, maxMBSortInHeap=7.289447143856184, sim=RandomSimilarity(queryNorm=false): {}, locale=en-SG, timezone=America/Araguaina
   [junit4]   2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_144 (32-bit)/cpus=3,threads=1,free=47163232,total=64880640
   [junit4]   2> NOTE: All tests run in this JVM: [IndexAndTaxonomyRevisionTest, SessionTokenTest, IndexAndTaxonomyReplicationClientTest, IndexReplicationClientTest]
   [junit4] Completed [8/9 (1!)] on J1 in 2.62s, 4 tests, 1 error <<< FAILURES!

[...truncated 3129 lines...]
   [junit4] Suite: org.apache.solr.handler.component.DistributedFacetPivotSmallTest
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\init-core-data-001
   [junit4]   2> 293930 WARN  (SUITE-DistributedFacetPivotSmallTest-seed#[9EB52C48F87166FE]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 293932 INFO  (SUITE-DistributedFacetPivotSmallTest-seed#[9EB52C48F87166FE]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 293937 INFO  (SUITE-DistributedFacetPivotSmallTest-seed#[9EB52C48F87166FE]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 293937 INFO  (SUITE-DistributedFacetPivotSmallTest-seed#[9EB52C48F87166FE]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 293938 INFO  (SUITE-DistributedFacetPivotSmallTest-seed#[9EB52C48F87166FE]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 294554 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\control\cores\collection1
   [junit4]   2> 294574 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 294575 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@dc4004{/,null,AVAILABLE}
   [junit4]   2> 294605 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1ea721d{SSL,[ssl, http/1.1]}{127.0.0.1:59921}
   [junit4]   2> 294605 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.Server Started @302656ms
   [junit4]   2> 294605 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=59921, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\control\cores}
   [junit4]   2> 294605 ERROR (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 294605 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 294605 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 294605 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 294605 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-09T14:30:40.884Z
   [junit4]   2> 294606 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\control\solr.xml
   [junit4]   2> 294614 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 294614 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 294625 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 294692 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 294699 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 294699 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 294702 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\control\cores
   [junit4]   2> 294702 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 294702 INFO  (coreLoadExecutor-1607-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 294703 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 294755 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 294780 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 294869 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 294880 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 294880 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 294880 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 294880 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\control\cores\collection1\data\]
   [junit4]   2> 294882 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=33.2470703125, floorSegmentMB=2.1005859375, forceMergeDeletesPctAllowed=12.311812098620331, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 294959 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 294960 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 294960 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 294960 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 294960 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=87.763671875, floorSegmentMB=0.9873046875, forceMergeDeletesPctAllowed=24.785336036792128, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8307204938684628
   [junit4]   2> 294960 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1ddbf80[collection1] main]
   [junit4]   2> 294960 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 294970 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 295001 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 295001 INFO  (searcherExecutor-1608-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 295001 INFO  (coreLoadExecutor-1607-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586317063650017280
   [junit4]   2> 295001 INFO  (searcherExecutor-1608-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 295001 INFO  (searcherExecutor-1608-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 295001 INFO  (searcherExecutor-1608-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 295001 INFO  (searcherExecutor-1608-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 295002 INFO  (searcherExecutor-1608-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 295002 INFO  (searcherExecutor-1608-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 295002 INFO  (searcherExecutor-1608-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 295002 INFO  (searcherExecutor-1608-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 295003 INFO  (searcherExecutor-1608-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1ddbf80[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 295441 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard0\cores\collection1
   [junit4]   2> 295446 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 295446 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@19669d8{/,null,AVAILABLE}
   [junit4]   2> 295446 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@a22ae4{SSL,[ssl, http/1.1]}{127.0.0.1:59924}
   [junit4]   2> 295446 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.Server Started @303498ms
   [junit4]   2> 295446 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=59924, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard0\cores}
   [junit4]   2> 295459 ERROR (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 295460 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 295460 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 295460 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 295460 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-09T14:30:41.739Z
   [junit4]   2> 295460 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard0\solr.xml
   [junit4]   2> 295466 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 295466 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 295468 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 295536 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 295543 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 295543 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 295546 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard0\cores
   [junit4]   2> 295546 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 295546 INFO  (coreLoadExecutor-1618-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 295547 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 295613 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 295632 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 295731 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 295749 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 295749 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 295749 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 295749 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard0\cores\collection1\data\]
   [junit4]   2> 295752 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=33.2470703125, floorSegmentMB=2.1005859375, forceMergeDeletesPctAllowed=12.311812098620331, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 295858 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 295858 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 295859 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 295859 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 295860 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=87.763671875, floorSegmentMB=0.9873046875, forceMergeDeletesPctAllowed=24.785336036792128, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8307204938684628
   [junit4]   2> 295860 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3bccb6[collection1] main]
   [junit4]   2> 295860 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 295870 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 295898 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 295898 INFO  (coreLoadExecutor-1618-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586317064590589952
   [junit4]   2> 295899 INFO  (searcherExecutor-1619-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 295899 INFO  (searcherExecutor-1619-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 295899 INFO  (searcherExecutor-1619-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 295899 INFO  (searcherExecutor-1619-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 295899 INFO  (searcherExecutor-1619-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 295900 INFO  (searcherExecutor-1619-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 295900 INFO  (searcherExecutor-1619-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 295900 INFO  (searcherExecutor-1619-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 295900 INFO  (searcherExecutor-1619-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 295901 INFO  (searcherExecutor-1619-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3bccb6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 296382 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard1\cores\collection1
   [junit4]   2> 296386 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 296386 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@10edf49{/,null,AVAILABLE}
   [junit4]   2> 296387 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@b62e38{SSL,[ssl, http/1.1]}{127.0.0.1:59967}
   [junit4]   2> 296387 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.Server Started @304438ms
   [junit4]   2> 296387 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=59967, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard1\cores}
   [junit4]   2> 296388 ERROR (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 296388 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 296388 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 296388 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 296388 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-09T14:30:42.667Z
   [junit4]   2> 296389 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard1\solr.xml
   [junit4]   2> 296394 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 296394 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 296395 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 296469 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 296487 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 296487 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 296492 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard1\cores
   [junit4]   2> 296492 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 296492 INFO  (coreLoadExecutor-1629-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 296495 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 296579 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 296609 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 296714 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 296727 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 296727 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 296727 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 296727 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard1\cores\collection1\data\]
   [junit4]   2> 296730 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=33.2470703125, floorSegmentMB=2.1005859375, forceMergeDeletesPctAllowed=12.311812098620331, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 296818 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 296818 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 296818 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 296818 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 296819 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=87.763671875, floorSegmentMB=0.9873046875, forceMergeDeletesPctAllowed=24.785336036792128, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8307204938684628
   [junit4]   2> 296820 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@10e2508[collection1] main]
   [junit4]   2> 296820 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 296828 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 296858 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 296859 INFO  (searcherExecutor-1630-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 296859 INFO  (coreLoadExecutor-1629-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586317065598271488
   [junit4]   2> 296859 INFO  (searcherExecutor-1630-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 296859 INFO  (searcherExecutor-1630-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 296859 INFO  (searcherExecutor-1630-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 296859 INFO  (searcherExecutor-1630-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 296860 INFO  (searcherExecutor-1630-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 296860 INFO  (searcherExecutor-1630-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 296860 INFO  (searcherExecutor-1630-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 296860 INFO  (searcherExecutor-1630-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 296862 INFO  (searcherExecutor-1630-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@10e2508[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 297863 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2\cores\collection1
   [junit4]   2> 297869 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 297870 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1b3c6c8{/,null,AVAILABLE}
   [junit4]   2> 297871 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@117af96{SSL,[ssl, http/1.1]}{127.0.0.1:59971}
   [junit4]   2> 297871 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.Server Started @305922ms
   [junit4]   2> 297871 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=59971, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2\cores}
   [junit4]   2> 297871 ERROR (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 297871 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 297871 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 297871 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 297871 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-09T14:30:44.150Z
   [junit4]   2> 297872 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2\solr.xml
   [junit4]   2> 297880 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 297880 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 297900 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 297993 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 297996 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 297996 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 298002 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2\cores
   [junit4]   2> 298002 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 298003 INFO  (coreLoadExecutor-1640-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 298004 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 298074 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 298092 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 298185 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 298195 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 298195 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 298196 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 298196 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard2\cores\collection1\data\]
   [junit4]   2> 298197 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=33.2470703125, floorSegmentMB=2.1005859375, forceMergeDeletesPctAllowed=12.311812098620331, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 298310 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 298310 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 298311 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 298311 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 298311 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=87.763671875, floorSegmentMB=0.9873046875, forceMergeDeletesPctAllowed=24.785336036792128, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8307204938684628
   [junit4]   2> 298312 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@84a52f[collection1] main]
   [junit4]   2> 298312 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 298318 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 298348 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 298348 INFO  (coreLoadExecutor-1640-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586317067159601152
   [junit4]   2> 298349 INFO  (searcherExecutor-1641-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 298349 INFO  (searcherExecutor-1641-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 298349 INFO  (searcherExecutor-1641-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 298349 INFO  (searcherExecutor-1641-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 298350 INFO  (searcherExecutor-1641-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 298350 INFO  (searcherExecutor-1641-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 298350 INFO  (searcherExecutor-1641-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 298351 INFO  (searcherExecutor-1641-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 298354 INFO  (searcherExecutor-1641-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 298355 INFO  (searcherExecutor-1641-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@84a52f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 298792 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard3\cores\collection1
   [junit4]   2> 298795 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 298795 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1853e71{/,null,AVAILABLE}
   [junit4]   2> 298796 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@16d5c1f{SSL,[ssl, http/1.1]}{127.0.0.1:59974}
   [junit4]   2> 298796 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.Server Started @306847ms
   [junit4]   2> 298796 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=59974, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard3\cores}
   [junit4]   2> 298797 ERROR (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 298798 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 298798 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 298798 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 298798 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-09T14:30:45.077Z
   [junit4]   2> 298798 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard3\solr.xml
   [junit4]   2> 298804 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 298804 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 298805 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 298872 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 298889 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 298890 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 298892 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard3\cores
   [junit4]   2> 298892 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 298893 INFO  (coreLoadExecutor-1651-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 298894 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib, /C:/Users/jenkins/workspace/Lucene-Solr-7.2-Windows/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 298948 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 298974 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 299059 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 299068 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1, trusted=true
   [junit4]   2> 299069 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@184a5ae
   [junit4]   2> 299069 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 299069 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J1\temp\solr.handler.component.DistributedFacetPivotSmallTest_9EB52C48F87166FE-001\tempDir-001\shard3\cores\collection1\data\]
   [junit4]   2> 299071 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=33.2470703125, floorSegmentMB=2.1005859375, forceMergeDeletesPctAllowed=12.311812098620331, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 299155 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 299155 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 299157 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 299157 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 299158 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=87.763671875, floorSegmentMB=0.9873046875, forceMergeDeletesPctAllowed=24.785336036792128, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8307204938684628
   [junit4]   2> 299159 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c636a5[collection1] main]
   [junit4]   2> 299159 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 299169 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 299210 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 299210 INFO  (coreLoadExecutor-1651-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586317068063473664
   [junit4]   2> 299211 INFO  (searcherExecutor-1652-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 299212 INFO  (searcherExecutor-1652-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 299212 INFO  (searcherExecutor-1652-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 299212 INFO  (searcherExecutor-1652-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 299213 INFO  (searcherExecutor-1652-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 299213 INFO  (searcherExecutor-1652-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 299213 INFO  (searcherExecutor-1652-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 299216 INFO  (searcherExecutor-1652-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 299216 INFO  (TEST-DistributedFacetPivotSmallTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 299216 INFO  (searcherExecutor-1652-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 299217 INFO  (searcherExecutor-1652-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1c636a5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 299380 INFO  (qtp5855039-3619) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1586317068238585856)} 0 3
   [junit4]   2> 299445 INFO  (qtp32728834-3634) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1586317068306743296)} 0 2
   [junit4]   2> 299495 INFO  (qtp15742192-3660) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1586317068357074944)} 0 5
   [junit4]   2> 299528 INFO  (qtp7334040-3675) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1586317068394823680)} 0 2
   [junit4]   2> 299570 INFO  (qtp13099741-3698) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1586317068437815296)} 0 3
   [junit4]   2> 299576 INFO  (qtp5855039-3620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[19 (1586317068443058176)]} 0 4
   [junit4]   2> 299583 INFO  (qtp7334040-3675) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[19 (1586317068448301056)]} 0 5
   [junit4]   2> 299585 INFO  (qtp5855039-3621) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[20 (1586317068455641088)]} 0 1
   [junit4]   2> 299588 INFO  (qtp32728834-3632) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[20 (1586317068457738240)]} 0 1
   [junit4]   2> 299590 INFO  (qtp5855039-3622) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[21 (1586317068460883968)]} 0 0
   [junit4]   2> 299595 INFO  (qtp15742192-3658) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[21 (1586317068464029696)]} 0 2
   [junit4]   2> 299596 INFO  (qtp5855039-3622) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[22 (1586317068468224000)]} 0 0
   [junit4]   2> 299599 INFO  (qtp7334040-3673) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[22 (1586317068469272576)]} 0 2
   [junit4]   2> 299600 INFO  (qtp5855039-3622) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[23 (1586317068472418304)]} 0 0
   [junit4]   2> 299606 INFO  (qtp13099741-3697) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[23 (1586317068474515456)]} 0 4
   [junit4]   2> 299608 INFO  (qtp5855039-3622) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[24 (1586317068480806912)]} 0 0
   [junit4]   2> 299611 INFO  (qtp32728834-3633) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[24 (1586317068481855488)]} 0 2
   [junit4]   2> 299613 INFO  (qtp5855039-3622) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[25 (1586317068486049792)]} 0 0
   [junit4]   2> 299615 INFO  (qtp15742192-3657) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[25 (1586317068487098368)]} 0 1
   [junit4]   2> 299616 INFO  (qtp5855039-3622) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[26 (1586317068489195520)]} 0 0
   [junit4]   2> 299618 INFO  (qtp7334040-3672) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[26 (1586317068490244096)]} 0 0
   [junit4]   2> 299619 INFO  (qtp5855039-3622) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[27 (1586317068491292672)]} 0 0
   [junit4]   2> 299623 INFO  (qtp13099741-3696) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[27 (1586317068493389824)]} 0 2
   [junit4]   2> 299624 INFO  (qtp5855039-3622) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[28 (1586317068497584128)]} 0 0
   [junit4]   2> 299625 INFO  (qtp32728834-3642) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[28 (1586317068498632704)]} 0 0
   [junit4]   2> 299626 INFO  (qtp5855039-3620) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1586317068499681280,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 299626 INFO  (qtp5855039-3620) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@d27e24 commitCommandVersion:1586317068499681280
   [junit4]   2> 299678 INFO  (qtp5855039-3620) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@f3f66e[collection1] main]
   [junit4]   2> 299678 INFO  (qtp5855039-3620) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 299679 INFO  (searcherExecutor-1608-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@f3f66e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.2.0):C10)))}
   [junit4]   2> 299680 INFO  (qtp5855039-3620) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 53
   [junit4]   2> 299681 INFO  (qtp32728834-3641) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1586317068557352960,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 299681 INFO  (qtp32728834-3641) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@67cb34 commitCommandVersion:1586317068557352960
   [junit4]   2> 299694 INFO  (qtp32728834-3641) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@d1a0a0[collection1] main]
   [junit4]   2> 299695 INFO  (qtp32728834-3641) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 299696 INFO  (searcherExecutor-1619-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@d1a0a0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.2.0):C3)))}
   [junit4]   2> 299696 INFO  (qtp32728834-3641) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 15
   [junit4]   2> 299697 INFO  (qtp15742192-3657) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1586317068574130176,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 299697 INFO  (qtp15742192-3657) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@f17c2e commitCommandVersion:1586317068574130176
   [junit4]   2> 299711 INFO  (qtp15742192-3657) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c6678d[collection1] main]
   [junit4]   2> 299711 INFO  (qtp15742192-3657) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 299902 INFO  (searcherExecutor-1630-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1c6678d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.2.0):C2)))}
   [junit4]   2> 299902 INFO  (qtp15742192-3657) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 206
   [junit4]   2> 299905 INFO  (qtp7334040-3672) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1586317068792233984,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 299905 INFO  (qtp7334040-3672) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@adfd7e commitCommandVersion:1586317068792233984
   [junit4]   2> 299913 INFO  (qtp7334040-3672) [    x:c

[...truncated too long message...]

porter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1a513fb: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@8f614c
   [junit4]   2> 1171825 INFO  (TEST-SolrCmdDistributorTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1d3c1cd{/,null,UNAVAILABLE}
   [junit4]   2> 1171827 INFO  (TEST-SolrCmdDistributorTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@114181c{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1171827 INFO  (TEST-SolrCmdDistributorTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=24917679
   [junit4]   2> 1171827 INFO  (TEST-SolrCmdDistributorTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1171827 INFO  (TEST-SolrCmdDistributorTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ebe0e4: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@13d771e
   [junit4]   2> 1171834 INFO  (TEST-SolrCmdDistributorTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1171834 INFO  (TEST-SolrCmdDistributorTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@81d5e7: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1b2ab9e
   [junit4]   2> 1171839 INFO  (TEST-SolrCmdDistributorTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1171839 INFO  (TEST-SolrCmdDistributorTest.test-seed#[9EB52C48F87166FE]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ceca33: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@95ae7c
   [junit4]   2> 1171840 INFO  (coreCloseExecutor-5191-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@b2ffd1
   [junit4]   2> 1171840 INFO  (coreCloseExecutor-5191-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=11730897
   [junit4]   2> 1171840 INFO  (coreCloseExecutor-5191-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@176429f: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@198d18f
   [junit4]   2> 1171849 INFO  (TEST-SolrCmdDistributorTest.test-seed#[9EB52C48F87166FE]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@755bf1{/,null,UNAVAILABLE}
   [junit4]   2> 1171853 INFO  (SUITE-SolrCmdDistributorTest-seed#[9EB52C48F87166FE]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=3, maxDocsPerChunk=938, blockSize=7), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=3, blockSize=7)), sim=RandomSimilarity(queryNorm=true): {}, locale=fr-CH, timezone=America/Danmarkshavn
   [junit4]   2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_144 (32-bit)/cpus=3,threads=1,free=158230544,total=349659136
   [junit4]   2> NOTE: All tests run in this JVM: [TestReloadAndDeleteDocs, BJQParserTest, BasicAuthIntegrationTest, TestBinaryField, TestManagedSchemaAPI, DistributedQueryElevationComponentTest, TestCoreAdminApis, SuggestComponentTest, TestQuerySenderListener, BasicDistributedZkTest, UninvertDocValuesMergePolicyTest, JvmMetricsTest, TestFieldCacheSort, CSVRequestHandlerTest, TestSubQueryTransformer, TestRecovery, TestTlogReplica, DistanceUnitsTest, TestZkAclsWithHadoopAuth, DirectoryFactoryTest, ReturnFieldsTest, LargeFieldTest, UniqFieldsUpdateProcessorFactoryTest, VersionInfoTest, TestLMDirichletSimilarityFactory, DocValuesMissingTest, JSONWriterTest, TestWriterPerf, TestNonDefinedSimilarityFactory, TestSha256AuthenticationProvider, IndexBasedSpellCheckerTest, SearchHandlerTest, TestMiniSolrCloudClusterSSL, FacetPivotSmallTest, TestTolerantUpdateProcessorRandomCloud, OverseerStatusTest, ChaosMonkeyNothingIsSafeTest, JavabinLoaderTest, TestRawTransformer, TestSchemaNameResource, TestTrieFacet, TestPHPSerializedResponseWriter, SystemLogListenerTest, DirectUpdateHandlerOptimizeTest, TestSweetSpotSimilarityFactory, TestExpandComponent, TestFieldCacheVsDocValues, TestSearcherReuse, OverseerModifyCollectionTest, StatsReloadRaceTest, TestDownShardTolerantSearch, DisMaxRequestHandlerTest, CdcrReplicationDistributedZkTest, TestDocBasedVersionConstraints, TestCursorMarkWithoutUniqueKey, SliceStateTest, HdfsUnloadDistributedZkTest, TestDynamicFieldCollectionResource, RecoveryZkTest, TriggerIntegrationTest, TestFuzzyAnalyzedSuggestions, HdfsChaosMonkeyNothingIsSafeTest, TestCustomSort, SolrGangliaReporterTest, AtomicUpdateProcessorFactoryTest, TestRandomRequestDistribution, TestIndexingPerformance, TestSolrConfigHandlerCloud, TestManagedStopFilterFactory, TestImpersonationWithHadoopAuth, ReplicaListTransformerTest, TestSolrCoreProperties, HdfsBasicDistributedZk2Test, PrimitiveFieldTypeTest, CoreMergeIndexesAdminHandlerTest, TestRangeQuery, TestSolrCloudWithDelegationTokens, ResponseHeaderTest, TestTestInjection, UUIDFieldTest, ConfigSetsAPITest, DeleteNodeTest, TestNamedUpdateProcessors, TestHdfsCloudBackupRestore, TestHighlightDedupGrouping, TestLeaderElectionZkExpiry, SecurityConfHandlerTest, URLClassifyProcessorTest, TestComplexPhraseLeadingWildcard, HdfsRestartWhileUpdatingTest, TestSimpleTextCodec, TestPrepRecovery, TestSolrXml, TestNumericTokenStream, RollingRestartTest, NumericFieldsTest, SolrRequestParserTest, OverriddenZkACLAndCredentialsProvidersTest, XsltUpdateRequestHandlerTest, TestLocalFSCloudBackupRestore, CdcrBidirectionalTest, TestSolrCoreParser, CursorPagingTest, CloudMLTQParserTest, TestOmitPositions, MetricsHandlerTest, TolerantUpdateProcessorTest, TestDFRSimilarityFactory, XmlUpdateRequestHandlerTest, MigrateRouteKeyTest, AsyncCallRequestStatusResponseTest, TestTolerantSearch, SuggesterTSTTest, DistributedVersionInfoTest, TestSolrCoreSnapshots, TestBulkSchemaConcurrent, DirectUpdateHandlerTest, MoveReplicaHDFSFailoverTest, DistributedFacetPivotSmallAdvancedTest, TestFieldTypeCollectionResource, RequiredFieldsTest, TestConfigSets, TestSystemCollAutoCreate, ExecutePlanActionTest, TestRTimerTree, SolrCmdDistributorTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrCmdDistributorTest -Dtests.seed=9EB52C48F87166FE -Dtests.slow=true -Dtests.locale=fr-CH -Dtests.timezone=America/Danmarkshavn -Dtests.asserts=true -Dtests.file.encoding=Cp1252
   [junit4] ERROR   0.00s J0 | SolrCmdDistributorTest (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default\conf: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default\conf
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets\_default
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1\configsets
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001\shard1
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.update.SolrCmdDistributorTest_9EB52C48F87166FE-001\tempDir-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([9EB52C48F87166FE]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [306/751 (3!)] on J0 in 8.76s, 1 test, 1 error <<< FAILURES!

[...truncated 44726 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.2-Windows (64bit/jdk-9.0.1) - Build # 8 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.2-Windows/8/
Java: 64bit/jdk-9.0.1 -XX:+UseCompressedOops -XX:+UseG1GC

4 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.lucene.analysis.snowball.TestSnowballVocab

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004\danish: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004\danish    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004\danish: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004\danish
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004

        at __randomizedtesting.SeedInfo.seed([CA7BF69C5F750154]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:51418/cpz/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:51418/cpz/collection1
        at __randomizedtesting.SeedInfo.seed([40F0FE14BCC3616C:C8A4C1CE123F0C94]:0)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
        at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:484)
        at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:463)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.commit(AbstractFullDistribZkTestBase.java:1582)
        at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:212)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
        at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.base/java.net.SocketInputStream.socketRead0(Native Method)
        at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.base/java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.base/java.net.SocketInputStream.read(SocketInputStream.java:141)
        at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
        at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
        at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
        at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
        at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
        at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
        at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
        at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
        at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
        at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
        at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
        at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
        at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
        at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
        at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
        ... 52 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest

Error Message:
9 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest:     1) Thread[id=8005, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    2) Thread[id=8030, name=zkCallback-1910-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    3) Thread[id=8194, name=zkCallback-1910-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    4) Thread[id=8195, name=zkCallback-1910-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    5) Thread[id=8006, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]-SendThread(127.0.0.1:51329), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)    6) Thread[id=8007, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]-EventThread, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)    7) Thread[id=8212, name=zkCallback-1910-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    8) Thread[id=8008, name=zkConnectionManagerCallback-1911-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    9) Thread[id=8255, name=zkCallback-1910-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 9 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest:
   1) Thread[id=8005, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   2) Thread[id=8030, name=zkCallback-1910-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   3) Thread[id=8194, name=zkCallback-1910-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   4) Thread[id=8195, name=zkCallback-1910-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   5) Thread[id=8006, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]-SendThread(127.0.0.1:51329), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   6) Thread[id=8007, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]-EventThread, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
        at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
   7) Thread[id=8212, name=zkCallback-1910-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   8) Thread[id=8008, name=zkConnectionManagerCallback-1911-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
        at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   9) Thread[id=8255, name=zkCallback-1910-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
        at __randomizedtesting.SeedInfo.seed([40F0FE14BCC3616C]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=8030, name=zkCallback-1910-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    2) Thread[id=8194, name=zkCallback-1910-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    3) Thread[id=8195, name=zkCallback-1910-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    4) Thread[id=8006, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]-SendThread(127.0.0.1:51329), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)    5) Thread[id=8212, name=zkCallback-1910-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    6) Thread[id=8008, name=zkConnectionManagerCallback-1911-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    7) Thread[id=8255, name=zkCallback-1910-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=8030, name=zkCallback-1910-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   2) Thread[id=8194, name=zkCallback-1910-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   3) Thread[id=8195, name=zkCallback-1910-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   4) Thread[id=8006, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]-SendThread(127.0.0.1:51329), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   5) Thread[id=8212, name=zkCallback-1910-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   6) Thread[id=8008, name=zkConnectionManagerCallback-1911-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
        at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   7) Thread[id=8255, name=zkCallback-1910-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
        at __randomizedtesting.SeedInfo.seed([40F0FE14BCC3616C]:0)




Build Log:
[...truncated 2619 lines...]
   [junit4] Suite: org.apache.lucene.analysis.snowball.TestSnowballVocab
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=fr-NE, timezone=Pacific/Noumea
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=3,threads=1,free=81102648,total=189792256
   [junit4]   2> NOTE: All tests run in this JVM: [TestGermanLightStemFilter, TestTwoFold, TestHunspellStemFilter, TestSoraniAnalyzer, TestNorwegianLightStemFilter, TestPorterStemFilter, TestMappingCharFilterFactory, TestCJKBigramFilterFactory, TestFinnishLightStemFilter, TestPersianNormalizationFilter, TestSoraniNormalizationFilterFactory, TestDecimalDigitFilterFactory, HTMLStripCharFilterTest, TestHungarianLightStemFilter, TestZeroAffix, TestGermanStemFilter, TestComplexPrefix, TestDuelingAnalyzers, TestLatvianStemmer, TestKeywordTokenizer, TestPortugueseMinimalStemFilterFactory, TestFinnishLightStemFilterFactory, TestSoraniStemFilterFactory, TestSynonymFilterFactory, TestSpanishAnalyzer, TestLimitTokenOffsetFilterFactory, EdgeNGramTokenizerTest, TestApostropheFilterFactory, TestCommonGramsFilterFactory, TestClassicAnalyzer, TestEnglishMinimalStemFilterFactory, TestGermanNormalizationFilter, TestCzechAnalyzer, TestBengaliStemmer, TestTrimFilterFactory, TestMorphAlias, TestScandinavianFoldingFilterFactory, TestPathHierarchyTokenizer, TestDependencies, TestLimitTokenPositionFilterFactory, TestCaseSensitive, NGramTokenFilterTest, TestStandardFactories, DateRecognizerFilterTest, TestSnowball, TestOptionalCondition, TestGalicianMinimalStemFilter, TestFilesystemResourceLoader, TestStemmer, TestRemoveDuplicatesTokenFilter, TestAlternateCasing, TestHindiFilters, TestRandomChains, TestStemmerOverrideFilterFactory, TestSynonymMapFilter, TestDictionaryCompoundWordTokenFilterFactory, TestReverseStringFilterFactory, TestAsciiFoldingFilterFactory, TestPersianNormalizationFilterFactory, TestCollationDocValuesField, NumericPayloadTokenFilterTest, TestPatternReplaceFilter, TestHyphenatedWordsFilter, TestSnowballPorterFilterFactory, TestPatternTokenizerFactory, TestWordnetSynonymParser, ShingleAnalyzerWrapperTest, TestHungarianAnalyzer, TestHungarianLightStemFilterFactory, TestGreekLowerCaseFilterFactory, TestLithuanianAnalyzer, TestAnalyzers, TestSnowballVocab]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSnowballVocab -Dtests.seed=CA7BF69C5F750154 -Dtests.slow=true -Dtests.locale=fr-NE -Dtests.timezone=Pacific/Noumea -Dtests.asserts=true -Dtests.file.encoding=Cp1252
   [junit4] ERROR   0.00s J1 | TestSnowballVocab (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004\danish: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004\danish
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\analysis\common\test\J1\temp\lucene.analysis.snowball.TestSnowballVocab_CA7BF69C5F750154-001\tempDir-004
   [junit4]    > at __randomizedtesting.SeedInfo.seed([CA7BF69C5F750154]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4] Completed [118/284 (1!)] on J1 in 14.07s, 1 test, 1 error <<< FAILURES!

[...truncated 9701 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\init-core-data-001
   [junit4]   2> 744961 WARN  (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[40F0FE14BCC3616C]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=68 numCloses=68
   [junit4]   2> 744962 INFO  (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[40F0FE14BCC3616C]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 744963 INFO  (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[40F0FE14BCC3616C]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776")
   [junit4]   2> 744963 INFO  (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[40F0FE14BCC3616C]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 744963 INFO  (SUITE-ChaosMonkeyNothingIsSafeTest-seed#[40F0FE14BCC3616C]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /cpz/
   [junit4]   2> 744965 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 744965 INFO  (Thread-1672) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 744965 INFO  (Thread-1672) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 744969 ERROR (Thread-1672) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 745066 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.ZkTestServer start zk server on port:51329
   [junit4]   2> 745069 INFO  (zkConnectionManagerCallback-1891-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 745073 INFO  (zkConnectionManagerCallback-1893-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 745079 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 745081 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 745082 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 745083 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 745084 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 745085 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 745087 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 745088 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 745089 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 745090 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 745091 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 745093 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 745412 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 745412 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9554637{/cpz,null,AVAILABLE}
   [junit4]   2> 745414 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3f2406f6{HTTP/1.1,[http/1.1]}{127.0.0.1:51336}
   [junit4]   2> 745414 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.Server Started @755109ms
   [junit4]   2> 745414 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/cpz, solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\tempDir-001/control/data, hostPort=51336, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\control-001\cores, replicaType=NRT}
   [junit4]   2> 745414 ERROR (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 745414 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 745414 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 745414 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 745414 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-10T02:50:16.358661500Z
   [junit4]   2> 745419 INFO  (zkConnectionManagerCallback-1895-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 745421 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 745421 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\control-001\solr.xml
   [junit4]   2> 745423 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 745423 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 745424 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1565739e, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 745427 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51329/solr
   [junit4]   2> 745429 INFO  (zkConnectionManagerCallback-1899-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 745430 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x1603e5489e90003, likely client has closed socket
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 745433 INFO  (zkConnectionManagerCallback-1901-thread-1-processing-n:127.0.0.1:51336_cpz) [n:127.0.0.1:51336_cpz    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 745522 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51336_cpz    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 745523 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51336_cpz    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51336_cpz
   [junit4]   2> 745524 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51336_cpz    ] o.a.s.c.Overseer Overseer (id=99147724614074372-127.0.0.1:51336_cpz-n_0000000000) starting
   [junit4]   2> 745530 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51336_cpz    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51336_cpz
   [junit4]   2> 745541 INFO  (OverseerStateUpdate-99147724614074372-127.0.0.1:51336_cpz-n_0000000000) [n:127.0.0.1:51336_cpz    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 745583 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51336_cpz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1565739e
   [junit4]   2> 745602 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51336_cpz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1565739e
   [junit4]   2> 745602 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51336_cpz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1565739e
   [junit4]   2> 745604 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51336_cpz    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\control-001\cores
   [junit4]   2> 745627 INFO  (zkConnectionManagerCallback-1907-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 745628 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 745629 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51329/solr ready
   [junit4]   2> 745631 INFO  (qtp1524581539-7970) [n:127.0.0.1:51336_cpz    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:51336_cpz&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 745633 INFO  (OverseerThreadFactory-3209-thread-1-processing-n:127.0.0.1:51336_cpz) [n:127.0.0.1:51336_cpz    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 745747 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 745748 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 745859 INFO  (zkCallback-1900-thread-1-processing-n:127.0.0.1:51336_cpz) [n:127.0.0.1:51336_cpz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 746765 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 746777 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 746838 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 746852 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 746852 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1565739e
   [junit4]   2> 746852 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 746852 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\control-001\cores\control_collection_shard1_replica_n1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\control-001\cores\control_collection_shard1_replica_n1\data\]
   [junit4]   2> 746858 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.20293782103272023]
   [junit4]   2> 746863 WARN  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 746914 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 746914 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 746915 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
   [junit4]   2> 746915 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 746916 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=39.0009765625, floorSegmentMB=1.474609375, forceMergeDeletesPctAllowed=12.009641119590755, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3031342616005442
   [junit4]   2> 746916 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6ed2220[control_collection_shard1_replica_n1] main]
   [junit4]   2> 746917 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 746918 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 746918 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 746920 INFO  (searcherExecutor-3212-thread-1-processing-n:127.0.0.1:51336_cpz x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@6ed2220[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 746920 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586363595870961664
   [junit4]   2> 746923 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 746923 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 746923 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:51336/cpz/control_collection_shard1_replica_n1/
   [junit4]   2> 746923 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 746923 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:51336/cpz/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 746923 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 746927 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:51336/cpz/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 747029 INFO  (zkCallback-1900-thread-2-processing-n:127.0.0.1:51336_cpz) [n:127.0.0.1:51336_cpz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 747038 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 747040 INFO  (qtp1524581539-7966) [n:127.0.0.1:51336_cpz c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1292
   [junit4]   2> 747051 INFO  (qtp1524581539-7970) [n:127.0.0.1:51336_cpz    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 747149 INFO  (zkCallback-1900-thread-1-processing-n:127.0.0.1:51336_cpz) [n:127.0.0.1:51336_cpz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 747636 INFO  (OverseerCollectionConfigSetProcessor-99147724614074372-127.0.0.1:51336_cpz-n_0000000000) [n:127.0.0.1:51336_cpz    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 748051 INFO  (qtp1524581539-7970) [n:127.0.0.1:51336_cpz    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:51336_cpz&wt=javabin&version=2} status=0 QTime=2420
   [junit4]   2> 748057 INFO  (zkConnectionManagerCallback-1911-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 748058 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 748059 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51329/solr ready
   [junit4]   2> 748059 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 748059 INFO  (qtp1524581539-7962) [n:127.0.0.1:51336_cpz    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 748061 INFO  (OverseerThreadFactory-3209-thread-2-processing-n:127.0.0.1:51336_cpz) [n:127.0.0.1:51336_cpz    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 748062 WARN  (OverseerThreadFactory-3209-thread-2-processing-n:127.0.0.1:51336_cpz) [n:127.0.0.1:51336_cpz    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 748266 INFO  (qtp1524581539-7962) [n:127.0.0.1:51336_cpz    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 748267 INFO  (qtp1524581539-7962) [n:127.0.0.1:51336_cpz    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=206
   [junit4]   2> 748547 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\shard-1-001 of type TLOG
   [junit4]   2> 748548 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 748548 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@67329db5{/cpz,null,AVAILABLE}
   [junit4]   2> 748549 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5191b34f{HTTP/1.1,[http/1.1]}{127.0.0.1:51385}
   [junit4]   2> 748549 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.Server Started @758244ms
   [junit4]   2> 748549 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/cpz, solrconfig=solrconfig.xml, solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\tempDir-001/jetty1, hostPort=51385, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\shard-1-001\cores, replicaType=TLOG}
   [junit4]   2> 748549 ERROR (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 748549 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 748549 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 748549 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 748549 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-10T02:50:19.493606800Z
   [junit4]   2> 748552 INFO  (zkConnectionManagerCallback-1913-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 748552 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 748553 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\shard-1-001\solr.xml
   [junit4]   2> 748555 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 748555 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 748556 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1565739e, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 748558 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51329/solr
   [junit4]   2> 748560 INFO  (zkConnectionManagerCallback-1917-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 748563 INFO  (zkConnectionManagerCallback-1919-thread-1-processing-n:127.0.0.1:51385_cpz) [n:127.0.0.1:51385_cpz    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 748569 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51385_cpz    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 748571 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51385_cpz    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 748573 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51385_cpz    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51385_cpz
   [junit4]   2> 748580 INFO  (zkCallback-1900-thread-1-processing-n:127.0.0.1:51336_cpz) [n:127.0.0.1:51336_cpz    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 748584 INFO  (zkCallback-1910-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 748584 INFO  (zkCallback-1918-thread-1-processing-n:127.0.0.1:51385_cpz) [n:127.0.0.1:51385_cpz    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 748653 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51385_cpz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1565739e
   [junit4]   2> 748661 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51385_cpz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1565739e
   [junit4]   2> 748661 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51385_cpz    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1565739e
   [junit4]   2> 748663 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [n:127.0.0.1:51385_cpz    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\shard-1-001\cores
   [junit4]   2> 748689 INFO  (qtp1524581539-7961) [n:127.0.0.1:51336_cpz    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:51385_cpz&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 748692 INFO  (OverseerCollectionConfigSetProcessor-99147724614074372-127.0.0.1:51336_cpz-n_0000000000) [n:127.0.0.1:51336_cpz    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 748693 INFO  (OverseerThreadFactory-3209-thread-3-processing-n:127.0.0.1:51336_cpz) [n:127.0.0.1:51336_cpz    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:51385_cpz for creating new replica
   [junit4]   2> 748698 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 748698 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 748803 INFO  (zkCallback-1918-thread-1-processing-n:127.0.0.1:51385_cpz) [n:127.0.0.1:51385_cpz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 749712 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 749722 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.IndexSchema [collection1_shard1_replica_t21] Schema name=test
   [junit4]   2> 749774 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 749790 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t21' using configuration from collection collection1, trusted=true
   [junit4]   2> 749791 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t21' (registry 'solr.core.collection1.shard1.replica_t21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1565739e
   [junit4]   2> 749791 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 749791 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrCore [[collection1_shard1_replica_t21] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\shard-1-001\cores\collection1_shard1_replica_t21], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\shard-1-001\cores\collection1_shard1_replica_t21\data\]
   [junit4]   2> 749796 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.20293782103272023]
   [junit4]   2> 749801 WARN  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 749861 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 749861 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 749862 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
   [junit4]   2> 749862 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 749862 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=39.0009765625, floorSegmentMB=1.474609375, forceMergeDeletesPctAllowed=12.009641119590755, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3031342616005442
   [junit4]   2> 749864 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b5268f4[collection1_shard1_replica_t21] main]
   [junit4]   2> 749864 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 749865 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 749865 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 749866 INFO  (searcherExecutor-3223-thread-1-processing-n:127.0.0.1:51385_cpz x:collection1_shard1_replica_t21 s:shard1 c:collection1) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SolrCore [collection1_shard1_replica_t21] Registered new searcher Searcher@1b5268f4[collection1_shard1_replica_t21] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 749866 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1586363598960066560
   [junit4]   2> 749871 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 749871 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 749871 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:51385/cpz/collection1_shard1_replica_t21/
   [junit4]   2> 749871 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 749871 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.SyncStrategy http://127.0.0.1:51385/cpz/collection1_shard1_replica_t21/ has no replicas
   [junit4]   2> 749871 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 749871 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ZkController collection1_shard1_replica_t21 stopping background replication from leader
   [junit4]   2> 749874 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:51385/cpz/collection1_shard1_replica_t21/ shard1
   [junit4]   2> 749977 INFO  (zkCallback-1918-thread-1-processing-n:127.0.0.1:51385_cpz) [n:127.0.0.1:51385_cpz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 750027 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 750029 INFO  (qtp1666207095-8012) [n:127.0.0.1:51385_cpz c:collection1 s:shard1  x:collection1_shard1_replica_t21] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1330
   [junit4]   2> 750031 INFO  (qtp1524581539-7961) [n:127.0.0.1:51336_cpz    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:51385_cpz&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1341
   [junit4]   2> 750197 INFO  (zkCallback-1918-thread-1-processing-n:127.0.0.1:51385_cpz) [n:127.0.0.1:51385_cpz    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 750421 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\shard-2-001 of type TLOG
   [junit4]   2> 750423 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 750423 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@599f0d3e{/cpz,null,AVAILABLE}
   [junit4]   2> 750424 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@489d1957{HTTP/1.1,[http/1.1]}{127.0.0.1:51418}
   [junit4]   2> 750424 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.e.j.s.Server Started @760118ms
   [junit4]   2> 750424 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/cpz, solrconfig=solrconfig.xml, solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\tempDir-001/jetty2, hostPort=51418, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeyNothingIsSafeTest_40F0FE14BCC3616C-001\shard-2-001\cores, replicaType=TLOG}
   [junit4]   2> 750425 ERROR (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 750425 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 750425 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 750425 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 750425 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-10T02:50:21.369061300Z
   [junit4]   2> 750427 INFO  (zkConnectionManagerCallback-1922-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 750427 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 750427 INFO  (TEST-ChaosMonkeyNothingIsSafeTest.test-see

[...truncated too long message...]

         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    >         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]    >    9) Thread[id=8255, name=zkCallback-1910-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    >         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]    > at __randomizedtesting.SeedInfo.seed([40F0FE14BCC3616C]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=8030, name=zkCallback-1910-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    >         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]    >    2) Thread[id=8194, name=zkCallback-1910-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    >         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]    >    3) Thread[id=8195, name=zkCallback-1910-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    >         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]    >    4) Thread[id=8006, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[40F0FE14BCC3616C]-SendThread(127.0.0.1:51329), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
   [junit4]    >         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
   [junit4]    >         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   [junit4]    >    5) Thread[id=8212, name=zkCallback-1910-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    >         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]    >    6) Thread[id=8008, name=zkConnectionManagerCallback-1911-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    >         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]    >    7) Thread[id=8255, name=zkCallback-1910-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]    >         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    >         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]    > at __randomizedtesting.SeedInfo.seed([40F0FE14BCC3616C]:0)
   [junit4] Completed [229/751 (1!)] on J0 in 80.14s, 1 test, 3 errors <<< FAILURES!

[...truncated 41803 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.2-Windows (32bit/jdk1.8.0_144) - Build # 9 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.2-Windows/9/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseParallelGC

6 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.lucene.index.TestBackwardsCompatibility

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\4.0.0.2-nocfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\4.0.0.2-nocfs-001    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\3.5.0-cfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\3.5.0-cfs-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\4.0.0.2-nocfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\4.0.0.2-nocfs-001
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\3.5.0-cfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\3.5.0-cfs-001

        at __randomizedtesting.SeedInfo.seed([C05B3161504B99E2]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.lucene.search.TestLRUQueryCache.testDocValuesUpdatesDontBreakCache

Error Message:
expected:<2> but was:<3>

Stack Trace:
java.lang.AssertionError: expected:<2> but was:<3>
        at __randomizedtesting.SeedInfo.seed([4CBB299758116CB6:1E8E15FA6AE32F9E]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:472)
        at org.junit.Assert.assertEquals(Assert.java:456)
        at org.apache.lucene.search.TestLRUQueryCache.testDocValuesUpdatesDontBreakCache(TestLRUQueryCache.java:1512)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.lucene.search.TestLRUQueryCache

Error Message:
2 threads leaked from SUITE scope at org.apache.lucene.search.TestLRUQueryCache:     1) Thread[id=1900, name=LuceneTestCase-340-thread-2, state=WAITING, group=TGRP-TestLRUQueryCache]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=1899, name=LuceneTestCase-340-thread-1, state=WAITING, group=TGRP-TestLRUQueryCache]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.lucene.search.TestLRUQueryCache:
   1) Thread[id=1900, name=LuceneTestCase-340-thread-2, state=WAITING, group=TGRP-TestLRUQueryCache]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=1899, name=LuceneTestCase-340-thread-1, state=WAITING, group=TGRP-TestLRUQueryCache]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([4CBB299758116CB6]:0)


FAILED:  junit.framework.TestSuite.org.apache.lucene.search.TestLRUQueryCache

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=1900, name=LuceneTestCase-340-thread-2, state=WAITING, group=TGRP-TestLRUQueryCache]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)    2) Thread[id=1899, name=LuceneTestCase-340-thread-1, state=WAITING, group=TGRP-TestLRUQueryCache]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=1900, name=LuceneTestCase-340-thread-2, state=WAITING, group=TGRP-TestLRUQueryCache]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   2) Thread[id=1899, name=LuceneTestCase-340-thread-1, state=WAITING, group=TGRP-TestLRUQueryCache]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([4CBB299758116CB6]:0)


FAILED:  junit.framework.TestSuite.org.apache.lucene.store.TestFileSwitchDirectory

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.store.TestFileSwitchDirectory_4CBB299758116CB6-001\bar-009: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.store.TestFileSwitchDirectory_4CBB299758116CB6-001\bar-009

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.store.TestFileSwitchDirectory_4CBB299758116CB6-001\bar-009: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.store.TestFileSwitchDirectory_4CBB299758116CB6-001\bar-009

        at __randomizedtesting.SeedInfo.seed([4CBB299758116CB6]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.request.SchemaTest

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-037: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-037    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming\conf: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming\conf    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-037: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-037
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming\conf: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming\conf
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets
   C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001

        at __randomizedtesting.SeedInfo.seed([B01B4EBC0314D822]:0)
        at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
        at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
        at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 1124 lines...]
   [junit4] Suite: org.apache.lucene.store.TestFileSwitchDirectory
   [junit4] IGNOR/A 0.02s J0 | TestFileSwitchDirectory.testFsyncDoesntCreateNewFiles
   [junit4]    > Assumption #1: test only works for FSDirectory subclasses
   [junit4] IGNOR/A 0.01s J0 | TestFileSwitchDirectory.testPendingDeletions
   [junit4]    > Assumption #1: we can only install VirusCheckingFS on an FSDirectory
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=true): {}, locale=es-AR, timezone=America/Merida
   [junit4]   2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_144 (32-bit)/cpus=3,threads=1,free=212667624,total=273940480
   [junit4]   2> NOTE: All tests run in this JVM: [TestIndexWriterOnVMError, TestLucene60PointsFormat, TestArrayUtil, TestSegmentCacheables, TestCodecs, TestMatchAllDocsQuery, TestReaderWrapperDVTypeCheck, TestTerm, TestAllFilesDetectTruncation, TestSortedSetDocValues, TestIndexWriterThreadsToSegments, TestSearch, TestDeterminizeLexicon, TestBagOfPositions, TestBinaryTerms, TestLongRangeFieldQueries, TestExceedMaxTermLength, TestSimpleFSDirectory, TestForUtil, TestLockFactory, TestEarlyTermination, TestFilterWeight, TestBooleanQuery, TestTermScorer, TestReusableStringReader, TestMinimize, TestLucene50StoredFieldsFormat, MultiCollectorTest, TestIndexWriterFromReader, TestTrackingDirectoryWrapper, TestIndexWriter, TestIndexManyDocuments, TestBufferedIndexInput, TestIntroSorter, TestMultiThreadTermVectors, TestRegExp, TestManyFields, TestDocInverterPerFieldErrorInfo, TestSimilarity2, TestMixedCodecs, TestDemoParallelLeafReader, TestMmapDirectory, TestIndexableField, TestAttributeSource, TestBooleanSimilarity, TestDoubleValuesSource, TestCloseableThreadLocal, TestSloppyPhraseQuery, TestTieredMergePolicy, TestTryDelete, TestCodecUtil, TestSearchForDuplicates, TestPointValues, TestSpanExplanations, TestDoc, TestNamedSPILoader, TestIndexWriterUnicode, TestTerms, Test4GBStoredFields, TestSimpleExplanationsOfNonMatches, TestCodecHoldsOpenFiles, TestAllFilesHaveCodecHeader, TestBoostQuery, TestDocsWithFieldSet, TestSpansEnum, TestTimSorter, Test2BSortedDocValuesOrds, TestBooleanMinShouldMatch, TestIndexWriterMerging, TestDirectPacked, TestMatchNoDocsQuery, TestByteArrayDataInput, TestSpanCollection, TestNormsFieldExistsQuery, TestNeverDelete, TestScoreCachingWrappingScorer, TestFilterDirectory, TestMultiCollector, TestPayloadsOnVectors, TestConsistentFieldNumbers, TestIndexWriterDeleteByQuery, TestSparseFixedBitDocIdSet, TestRamUsageEstimator, TestSingleInstanceLockFactory, TestBytesRef, TestSimpleAttributeImpl, TestPriorityQueue, TestFieldInvertState, TestTopFieldCollectorEarlyTermination, TestFieldCacheRewriteMethod, TestIndexWriterExceptions, TestTopDocsCollector, TestNRTReaderCleanup, TestMultiset, TestSynonymQuery, TestMergePolicyWrapper, TestGeoEncodingUtils, TestAxiomaticSimilarity, TestMathUtil, TestPhrasePrefixQuery, TestCharacterUtils, TestDirectoryReader, TestDocCount, TestIntBlockPool, TestNotDocIdSet, TestRecyclingIntBlockAllocator, TestRAMDirectory, TestPositionIncrement, TestTimeLimitingCollector, TestBlockPostingsFormat2, TestScorerPerf, TestTwoPhaseCommitTool, TestIndexWriterMergePolicy, Test2BPositions, TestPerFieldDocValuesFormat, TestFSTs, TestBytesStore, TestPackedInts, TestIndexWriterWithThreads, TestGraphTokenizers, TestAddIndexes, TestMultiMMap, TestBooleanOr, TestBasics, TestFlushByRamOrCountsPolicy, TestNRTThreads, TestDuelingCodecs, TestPersistentSnapshotDeletionPolicy, TestAtomicUpdate, TestStressAdvance, TestNorms, TestStandardAnalyzer, TestIndexWriterCommit, TestDirectoryReaderReopen, TestSearchWithThreads, TestSearchAfter, TestConcurrentMergeScheduler, TestHighCompressionMode, TestDocumentsWriterStallControl, TestTopDocsMerge, TestLongPostings, TestSnapshotDeletionPolicy, TestPerFieldPostingsFormat, TestLevenshteinAutomata, TestByteSlices, TestWeakIdentityMap, TestPhraseQuery, TestCollectionUtil, TestComplexExplanations, TestRegexpRandom2, TestSegmentReader, TestFastDecompressionMode, TestParallelCompositeReader, TestCrash, TestPerFieldPostingsFormat2, TestSort, TestToken, TestFieldsReader, TestSimpleSearchEquivalence, TestCustomSearcherSort, TestDocValuesIndexing, TestSimilarityBase, TestHugeRamFile, Test2BDocs, TestSpans, TestCustomNorms, TestPostingsOffsets, TestTransactionRollback, TestFlex, TestUTF32ToUTF8, TestStressIndexing2, TestLazyProxSkipping, TestDeterminism, TestDocsAndPositions, TestBagOfPostings, TestTermVectorsWriter, TestCharTermAttributeImpl, TestOmitPositions, TestParallelLeafReader, TestThreadedForceMerge, TestIndexInput, TestSloppyPhraseQuery2, TestDisjunctionMaxQuery, TestForceMergeForever, TestOmitTf, TestSameScoresWithThreads, TestTermRangeQuery, TestDocumentsWriterDeleteQueue, TestDocumentWriter, TestCrashCausesCorruptIndex, TestLiveFieldValues, TestSpanSearchEquivalence, TestPayloads, TestFieldMaskingSpanQuery, TestExternalCodecs, TestRegexpQuery, TestPrefixInBooleanQuery, TestSegmentTermEnum, TestUniqueTermCount, TestComplexExplanationsOfNonMatches, TestUnicodeUtil, TestPrefixCodedTerms, TestParallelReaderEmptyIndex, TestDocument, TestFileSwitchDirectory]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFileSwitchDirectory -Dtests.seed=4CBB299758116CB6 -Dtests.slow=true -Dtests.locale=es-AR -Dtests.timezone=America/Merida -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | TestFileSwitchDirectory (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.store.TestFileSwitchDirectory_4CBB299758116CB6-001\bar-009: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\core\test\J0\temp\lucene.store.TestFileSwitchDirectory_4CBB299758116CB6-001\bar-009
   [junit4]    > at __randomizedtesting.SeedInfo.seed([4CBB299758116CB6]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [275/458 (1!)] on J0 in 1.69s, 43 tests, 1 error, 2 skipped <<< FAILURES!

[...truncated 513 lines...]
   [junit4] Suite: org.apache.lucene.search.TestLRUQueryCache
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLRUQueryCache -Dtests.method=testDocValuesUpdatesDontBreakCache -Dtests.seed=4CBB299758116CB6 -Dtests.slow=true -Dtests.locale=sl-SI -Dtests.timezone=Universal -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.01s J1 | TestLRUQueryCache.testDocValuesUpdatesDontBreakCache <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<2> but was:<3>
   [junit4]    > at __randomizedtesting.SeedInfo.seed([4CBB299758116CB6:1E8E15FA6AE32F9E]:0)
   [junit4]    > at org.apache.lucene.search.TestLRUQueryCache.testDocValuesUpdatesDontBreakCache(TestLRUQueryCache.java:1512)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Dec 10, 2017 12:29:05 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> Dec 10, 2017 12:29:25 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 2 threads leaked from SUITE scope at org.apache.lucene.search.TestLRUQueryCache:
   [junit4]   2>    1) Thread[id=1900, name=LuceneTestCase-340-thread-2, state=WAITING, group=TGRP-TestLRUQueryCache]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    2) Thread[id=1899, name=LuceneTestCase-340-thread-1, state=WAITING, group=TGRP-TestLRUQueryCache]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Dec 10, 2017 12:29:25 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=1900, name=LuceneTestCase-340-thread-2, state=WAITING, group=TGRP-TestLRUQueryCache]
   [junit4]   2>    2) Thread[id=1899, name=LuceneTestCase-340-thread-1, state=WAITING, group=TGRP-TestLRUQueryCache]
   [junit4]   2> Dec 10, 2017 12:29:28 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=1900, name=LuceneTestCase-340-thread-2, state=WAITING, group=TGRP-TestLRUQueryCache]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2>    2) Thread[id=1899, name=LuceneTestCase-340-thread-1, state=WAITING, group=TGRP-TestLRUQueryCache]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {color=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), f=PostingsFormat(name=MockRandom), foo=PostingsFormat(name=MockRandom), text=PostingsFormat(name=LuceneFixedGap)}, docValues:{field=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=520, maxMBSortInHeap=5.1498798066536855, sim=RandomSimilarity(queryNorm=false): {foo=DFR I(ne)Z(0.3), text=DFR I(ne)L1}, locale=sl-SI, timezone=Universal
   [junit4]   2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_144 (32-bit)/cpus=3,threads=3,free=24731064,total=271843328
   [junit4]   2> NOTE: All tests run in this JVM: [TestCharsRef, TestSegmentMerger, TestMSBRadixSorter, Test2BPostings, TestDelegatingAnalyzerWrapper, TestStringMSBRadixSorter, TestDemo, TestIndexWriterExceptions2, TestOmitNorms, TestFixedLengthBytesRefArray, TestNumericDocValuesUpdates, TestIndexingSequenceNumbers, TestIndexWriterMaxDocs, TestDoubleRangeFieldQueries, TestNRTCachingDirectory, TestIndexWriterDelete, TestTermdocPerf, TestSearcherManager, TestFloatRangeFieldQueries, TestMergeRateLimiter, TestIndexWriterOnJRECrash, TestIndexReaderClose, TestBytesRefHash, TestLucene60FieldInfoFormat, TestPagedBytes, TestSleepingLockWrapper, TestFieldType, TestFastCompressionMode, TestMaxTermFrequency, TestSegmentTermDocs, TestMinShouldMatch2, TestSegmentInfos, TestTopFieldCollector, TestRollback, TestSpanNotQuery, TestTermQuery, TestNeedsScores, Test2BPagedBytes, TestDirectMonotonic, TestGrowableByteArrayDataOutput, TestBlockPostingsFormat, TestPolygon2D, TestSmallFloat, TestStressNRT, TestFixedBitSet, TestTermVectorsReader, TermInSetQueryTest, TestMultiDocValues, TestMergedIterator, TestNearSpansOrdered, TestTimSorterWorstCase, TestFieldReuse, TestDeletionPolicy, TestShardSearching, TestIndexWriterOutOfFileDescriptors, TestSizeBoundedForceMerge, TestSpanTermQuery, TestCharArraySet, TestTragicIndexWriterDeadlock, TestAutomatonQuery, TestCachingCollector, TestGeoUtils, TestRoaringDocIdSet, TestTermsEnum2, TestCompiledAutomaton, TestLucene70NormsFormat, TestMultiFields, TestBoolean2, TestIndexCommit, Test2BBinaryDocValues, TestFuzzyQuery, TestDocValuesQueries, TestTermsEnum, TestWildcard, TestSubScorerFreqs, TestSimpleFSLockFactory, TestLucene50CompoundFormat, TestNRTReaderWithThreads, TestMultiTermQueryRewrites, TestStressIndexing, TestMultiPhraseQuery, TestForTooMuchCloning, TestIndexWriterNRTIsCurrent, TestIndexWriterLockRelease, TestSpanBoostQuery, TestSimilarity, TestSimpleExplanationsWithFillerDocs, TestLogMergePolicy, TestReaderClosed, TestSpanContainQuery, TestAllFilesCheckIndexHeader, Test2BTerms, TestBytesRefArray, TestIndexSearcher, TestDuelingCodecsAtNight, TestIndexWriterReader, TestRollingUpdates, TestSimpleExplanations, TestBlendedTermQuery, TestSortRandom, TestGraphTokenStreamFiniteStrings, TestIndexWriterForceMerge, TestMergeSchedulerExternal, TestSloppyMath, TestElevationComparator, TestNoDeletionPolicy, TestSortedNumericSortField, TestAllFilesHaveChecksumFooter, TestMultiTermConstantScore, TestPerSegmentDeletes, TestCustomTermFreq, TestTransactions, TestIndexWriterOnDiskFull, TestUpgradeIndexMergePolicy, TestLucene70SegmentInfoFormat, TestPolygon, Test2BPoints, Test2BSortedDocValuesFixedSorted, TestBinaryDocValuesUpdates, TestDocIDMerger, TestDocValues, TestExitableDirectoryReader, TestFilterCodecReader, TestFilterDirectoryReader, TestIndexSorting, TestIndexTooManyDocs, TestInfoStream, TestMaxPosition, TestMixedDocValuesUpdates, TestMultiTermsEnum, TestOneMergeWrappingMergePolicy, TestOrdinalMap, TestReadOnlyIndex, TestStressDeletes, TestSwappedIndexFiles, TestTermVectors, FuzzyTermOnShortTermsTest, TestApproximationSearchEquivalence, TestBoolean2ScorerSupplier, TestBooleanRewrites, TestConjunctionDISI, TestControlledRealTimeReopenThread, TestDocValuesRewriteMethod, TestEarlyTerminatingSortingCollector, TestFieldValueQuery, TestIndexOrDocValuesQuery, TestIntRangeFieldQueries, TestLRUQueryCache]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLRUQueryCache -Dtests.seed=4CBB299758116CB6 -Dtests.slow=true -Dtests.locale=sl-SI -Dtests.timezone=Universal -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestLRUQueryCache (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.lucene.search.TestLRUQueryCache:
   [junit4]    >    1) Thread[id=1900, name=LuceneTestCase-340-thread-2, state=WAITING, group=TGRP-TestLRUQueryCache]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    2) Thread[id=1899, name=LuceneTestCase-340-thread-1, state=WAITING, group=TGRP-TestLRUQueryCache]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    > at __randomizedtesting.SeedInfo.seed([4CBB299758116CB6]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=1900, name=LuceneTestCase-340-thread-2, state=WAITING, group=TGRP-TestLRUQueryCache]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    >    2) Thread[id=1899, name=LuceneTestCase-340-thread-1, state=WAITING, group=TGRP-TestLRUQueryCache]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >         at java.lang.Thread.run(Thread.java:748)
   [junit4]    > at __randomizedtesting.SeedInfo.seed([4CBB299758116CB6]:0)
   [junit4] Completed [431/458 (2!)] on J1 in 24.94s, 21 tests, 1 failure, 2 errors <<< FAILURES!

[...truncated 2957 lines...]
   [junit4] Suite: org.apache.lucene.index.TestBackwardsCompatibility
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateNoCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateSingleSegmentCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateMoreTermsIndex
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateEmptyIndex
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateIndexWithDocValuesUpdates
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateSingleSegmentNoCFS
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4] IGNOR/A 0.00s J0 | TestBackwardsCompatibility.testCreateSortedIndex
   [junit4]    > Assumption #1: backcompat creation tests must be run with -Dtests.bwcdir=/path/to/write/indexes
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {content6=DFR GB2, content5=IB SPL-D1, content2=IB SPL-L1, utf8=DFR I(n)L2, fie?ld=DFR I(F)L3(800.0), content=DFR I(ne)L2, autf8=DFR I(n)1}, locale=fr-FR, timezone=Europe/Sarajevo
   [junit4]   2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_144 (32-bit)/cpus=3,threads=1,free=69684928,total=171704320
   [junit4]   2> NOTE: All tests run in this JVM: [TestLucene54DocValuesFormat, TestLucene50SegmentInfoFormat, TestBackwardsCompatibility]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestBackwardsCompatibility -Dtests.seed=C05B3161504B99E2 -Dtests.slow=true -Dtests.locale=fr-FR -Dtests.timezone=Europe/Sarajevo -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | TestBackwardsCompatibility (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\4.0.0.2-nocfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\4.0.0.2-nocfs-001
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\3.5.0-cfs-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\lucene\build\backward-codecs\test\J0\temp\lucene.index.TestBackwardsCompatibility_C05B3161504B99E2-001\3.5.0-cfs-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([C05B3161504B99E2]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [8/8 (1!)] on J0 in 25.80s, 30 tests, 1 error, 8 skipped <<< FAILURES!

[...truncated 10388 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.request.SchemaTest
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\init-core-data-001
   [junit4]   2> 141963 WARN  (SUITE-SchemaTest-seed#[B01B4EBC0314D822]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
   [junit4]   2> 141963 INFO  (SUITE-SchemaTest-seed#[B01B4EBC0314D822]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 141969 INFO  (SUITE-SchemaTest-seed#[B01B4EBC0314D822]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 141969 INFO  (SUITE-SchemaTest-seed#[B01B4EBC0314D822]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 141971 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSchemaRequestAccuracy
   [junit4]   2> 142118 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 142118 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 142119 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-003\cores\core
   [junit4]   2> 142125 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 142126 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@81d725{/solr,null,AVAILABLE}
   [junit4]   2> 142128 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@18bbf21{HTTP/1.1,[http/1.1]}{127.0.0.1:64122}
   [junit4]   2> 142128 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.Server Started @150047ms
   [junit4]   2> 142128 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64122, configSetBaseDir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-003\cores}
   [junit4]   2> 142128 ERROR (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 142128 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 142129 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 142129 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 142129 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-10T13:53:45.304Z
   [junit4]   2> 142132 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\solr.xml
   [junit4]   2> 142177 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 142409 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 142435 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 142435 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 142443 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-003\cores
   [junit4]   2> 142443 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 142450 INFO  (coreLoadExecutor-632-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 142550 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 142601 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 142693 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 142890 WARN  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 142890 WARN  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 142891 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 142897 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\collection1\conf\managed-schema
   [junit4]   2> 142900 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema, renamed the non-managed schema C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\collection1\conf\schema.xml to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\collection1\conf\schema.xml.bak
   [junit4]   2> 142901 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\collection1, trusted=true
   [junit4]   2> 142901 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 142901 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 142901 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-003\cores\core\data\]
   [junit4]   2> 143156 WARN  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.c.RequestHandlers no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 143157 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 143157 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 143160 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@f1e4f6[collection1] main]
   [junit4]   2> 143162 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\collection1\conf
   [junit4]   2> 143163 INFO  (coreLoadExecutor-632-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 143164 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrJettyTestBase Jetty Assigned Port#64122
   [junit4]   2> 143165 INFO  (searcherExecutor-633-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@f1e4f6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 143182 INFO  (qtp26419870-2489) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 143244 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@18bbf21{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 143244 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2979467
   [junit4]   2> 143244 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 143244 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2cc17c: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@f967e4
   [junit4]   2> 143255 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 143256 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6362b1: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@243d87
   [junit4]   2> 143263 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 143263 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1835f1e: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1077974
   [junit4]   2> 143264 INFO  (coreCloseExecutor-637-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1ea9c4
   [junit4]   2> 143265 INFO  (coreCloseExecutor-637-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=2009540
   [junit4]   2> 143265 INFO  (coreCloseExecutor-637-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@f9aafa: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@103eda8
   [junit4]   2> 143278 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@81d725{/solr,null,UNAVAILABLE}
   [junit4]   2> 143280 INFO  (TEST-SchemaTest.testSchemaRequestAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testSchemaRequestAccuracy
   [junit4]   2> 143283 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testGetDynamicFieldsAccuracy
   [junit4]   2> 143430 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 143430 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 143430 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-006\cores\core
   [junit4]   2> 143441 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 143442 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a1ce91{/solr,null,AVAILABLE}
   [junit4]   2> 143443 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@118b131{HTTP/1.1,[http/1.1]}{127.0.0.1:64126}
   [junit4]   2> 143443 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.Server Started @151362ms
   [junit4]   2> 143443 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64126, configSetBaseDir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-004, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-006\cores}
   [junit4]   2> 143459 ERROR (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 143466 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 143466 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 143466 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 143466 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-10T13:53:46.641Z
   [junit4]   2> 143466 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-004\solr.xml
   [junit4]   2> 143481 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 143626 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 143645 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 143645 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 143651 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-006\cores
   [junit4]   2> 143651 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 143651 INFO  (coreLoadExecutor-644-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 143703 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 143716 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 143727 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 143853 WARN  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 143853 WARN  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 143854 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 143858 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-004\collection1\conf\managed-schema
   [junit4]   2> 143861 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema, renamed the non-managed schema C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-004\collection1\conf\schema.xml to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-004\collection1\conf\schema.xml.bak
   [junit4]   2> 143862 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-004\collection1, trusted=true
   [junit4]   2> 143862 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 143863 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 143863 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-004\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-006\cores\core\data\]
   [junit4]   2> 144087 WARN  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.c.RequestHandlers no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 144087 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 144087 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 144144 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@afd575[collection1] main]
   [junit4]   2> 144145 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-004\collection1\conf
   [junit4]   2> 144147 INFO  (coreLoadExecutor-644-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 144157 INFO  (searcherExecutor-645-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@afd575[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 144649 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrJettyTestBase Jetty Assigned Port#64126
   [junit4]   2> 144667 INFO  (qtp7755123-2523) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema/dynamicfields params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 144670 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@118b131{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 144670 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=22889441
   [junit4]   2> 144670 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 144670 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@75db0a: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@225897
   [junit4]   2> 144685 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 144685 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@bd8d1d: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@243d87
   [junit4]   2> 144699 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 144700 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@30dfe5: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1077974
   [junit4]   2> 144701 INFO  (coreCloseExecutor-649-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@e5e0e6
   [junit4]   2> 144701 INFO  (coreCloseExecutor-649-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=15065318
   [junit4]   2> 144701 INFO  (coreCloseExecutor-649-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1a7c2cc: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@11ae1d5
   [junit4]   2> 144736 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@a1ce91{/solr,null,UNAVAILABLE}
   [junit4]   2> 144740 INFO  (TEST-SchemaTest.testGetDynamicFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testGetDynamicFieldsAccuracy
   [junit4]   2> 144742 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testReplaceFieldTypeAccuracy
   [junit4]   2> 144894 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 144894 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 144895 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-009\cores\core
   [junit4]   2> 144900 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 144900 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@517b03{/solr,null,AVAILABLE}
   [junit4]   2> 144900 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1a6a3c7{HTTP/1.1,[http/1.1]}{127.0.0.1:64130}
   [junit4]   2> 144900 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.Server Started @152821ms
   [junit4]   2> 144900 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64130, configSetBaseDir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-007, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-009\cores}
   [junit4]   2> 144900 ERROR (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 144912 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 144912 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 144912 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 144912 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-10T13:53:48.087Z
   [junit4]   2> 144912 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-007\solr.xml
   [junit4]   2> 144929 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 145085 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 145101 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 145101 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 145107 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-009\cores
   [junit4]   2> 145107 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 145107 INFO  (coreLoadExecutor-656-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 145179 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 145196 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 145212 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 145368 WARN  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 145368 WARN  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 145369 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 145373 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-007\collection1\conf\managed-schema
   [junit4]   2> 145384 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema, renamed the non-managed schema C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-007\collection1\conf\schema.xml to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-007\collection1\conf\schema.xml.bak
   [junit4]   2> 145385 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-007\collection1, trusted=true
   [junit4]   2> 145386 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 145386 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 145386 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-007\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-009\cores\core\data\]
   [junit4]   2> 145610 WARN  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.c.RequestHandlers no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 145611 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 145611 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 145615 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@12ce570[collection1] main]
   [junit4]   2> 145616 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-007\collection1\conf
   [junit4]   2> 145618 INFO  (coreLoadExecutor-656-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 145619 INFO  (searcherExecutor-657-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@12ce570[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 146124 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrJettyTestBase Jetty Assigned Port#64130
   [junit4]   2> 146256 INFO  (qtp6363973-2539) [    x:collection1] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-007\collection1\conf\managed-schema
   [junit4]   2> 146276 INFO  (qtp6363973-2539) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=136
   [junit4]   2> 146289 INFO  (qtp6363973-2543) [    x:collection1] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-007\collection1\conf\managed-schema
   [junit4]   2> 146307 INFO  (qtp6363973-2543) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=23
   [junit4]   2> 146311 INFO  (qtp6363973-2544) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema/fieldtypes/replaceInt params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 146317 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1a6a3c7{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 146317 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=17427995
   [junit4]   2> 146317 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 146317 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c3e99a: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1beac7f
   [junit4]   2> 146325 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 146325 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1cc9db9: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@243d87
   [junit4]   2> 146332 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 146332 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4c0744: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1077974
   [junit4]   2> 146333 INFO  (coreCloseExecutor-661-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@77f0b0
   [junit4]   2> 146333 INFO  (coreCloseExecutor-661-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=7860400
   [junit4]   2> 146333 INFO  (coreCloseExecutor-661-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1fc4822: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@105c37e
   [junit4]   2> 146357 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@517b03{/solr,null,UNAVAILABLE}
   [junit4]   2> 146359 INFO  (TEST-SchemaTest.testReplaceFieldTypeAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testReplaceFieldTypeAccuracy
   [junit4]   2> 146359 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testGetCopyFieldsAccuracy
   [junit4]   2> 146503 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 146503 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 146508 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-012\cores\core
   [junit4]   2> 146513 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 146513 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@da6bb4{/solr,null,AVAILABLE}
   [junit4]   2> 146513 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@16315b2{HTTP/1.1,[http/1.1]}{127.0.0.1:64134}
   [junit4]   2> 146513 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.Server Started @154434ms
   [junit4]   2> 146513 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=64134, configSetBaseDir=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-010, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-012\cores}
   [junit4]   2> 146513 ERROR (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 146513 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 146513 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 146513 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 146513 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-12-10T13:53:49.688Z
   [junit4]   2> 146513 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-010\solr.xml
   [junit4]   2> 146532 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 146693 INFO  (TEST-SchemaTest.testGetCopyFieldsAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4abfd2
   [junit4]   2> 14

[...truncated too long message...]

 184949 INFO  (coreLoadExecutor-1040-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 184968 INFO  (coreLoadExecutor-1040-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@685030[collection1] main]
   [junit4]   2> 184969 INFO  (coreLoadExecutor-1040-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-103\collection1\conf
   [junit4]   2> 184973 INFO  (coreLoadExecutor-1040-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 184975 INFO  (TEST-SchemaTest.addFieldTypeWithAnalyzerClassAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrJettyTestBase Jetty Assigned Port#65503
   [junit4]   2> 184976 INFO  (searcherExecutor-1041-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@685030[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 185010 INFO  (qtp29845751-3291) [    x:collection1] o.a.s.s.ManagedIndexSchema Upgraded to managed schema at C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-103\collection1\conf\managed-schema
   [junit4]   2> 185020 INFO  (qtp29845751-3291) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=26
   [junit4]   2> 185022 INFO  (qtp29845751-3294) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/schema/fieldtypes/nameText params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 185024 INFO  (TEST-SchemaTest.addFieldTypeWithAnalyzerClassAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@198fdd6{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 185024 INFO  (TEST-SchemaTest.addFieldTypeWithAnalyzerClassAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=27200493
   [junit4]   2> 185024 INFO  (TEST-SchemaTest.addFieldTypeWithAnalyzerClassAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 185025 INFO  (TEST-SchemaTest.addFieldTypeWithAnalyzerClassAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@13b68fa: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1d821c3
   [junit4]   2> 185034 INFO  (TEST-SchemaTest.addFieldTypeWithAnalyzerClassAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 185034 INFO  (TEST-SchemaTest.addFieldTypeWithAnalyzerClassAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1c86a68: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@243d87
   [junit4]   2> 185059 INFO  (TEST-SchemaTest.addFieldTypeWithAnalyzerClassAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 185059 INFO  (TEST-SchemaTest.addFieldTypeWithAnalyzerClassAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@b5d104: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1077974
   [junit4]   2> 185062 INFO  (coreCloseExecutor-1045-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@12daf5b
   [junit4]   2> 185062 INFO  (coreCloseExecutor-1045-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=19771227
   [junit4]   2> 185062 INFO  (coreCloseExecutor-1045-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@19824ad: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@f0dd52
   [junit4]   2> 185091 INFO  (TEST-SchemaTest.addFieldTypeWithAnalyzerClassAccuracy-seed#[B01B4EBC0314D822]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@13ae91a{/solr,null,UNAVAILABLE}
   [junit4]   2> 185093 INFO  (TEST-SchemaTest.addFieldTypeWithAnalyzerClassAccuracy-seed#[B01B4EBC0314D822]) [    ] o.a.s.SolrTestCaseJ4 ###Ending addFieldTypeWithAnalyzerClassAccuracy
   [junit4]   2> 185094 INFO  (SUITE-SchemaTest-seed#[B01B4EBC0314D822]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=true): {}, locale=mk, timezone=Africa/Niamey
   [junit4]   2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_144 (32-bit)/cpus=3,threads=1,free=168916864,total=269746176
   [junit4]   2> NOTE: All tests run in this JVM: [DivideEvaluatorTest, JDBCStreamTest, LargeVolumeBinaryJettyTest, JsonValidatorTest, LargeVolumeJettyTest, LargeVolumeEmbeddedTest, JdbcDriverTest, TestValidatingJsonMap, AscEvaluatorTest, RoundEvaluatorTest, CommonParamsTest, NormalizeEvaluatorTest, TestFastInputStream, HyperbolicCosineEvaluatorTest, ArcCosineEvaluatorTest, SolrExampleStreamingBinaryTest, StreamExpressionParserTest, QueryResponseTest, BasicHttpSolrClientTest, TestConfigSetAdminRequest, TestPathTrie, FieldValueEvaluatorTest, AndEvaluatorTest, SolrExampleBinaryTest, ArcTangentEvaluatorTest, SolrPingTest, SolrExampleJettyTest, LBHttpSolrClientBuilderTest, SolrSchemalessExampleTest, TangentEvaluatorTest, HyperbolicTangentEvaluatorTest, LessThanEqualToEvaluatorTest, TestNamedListCodec, GraphExpressionTest, TestSolrProperties, SolrParamTest, TestCoreAdmin, TestSolrJErrorHandling, ConcurrentUpdateSolrClientBuilderTest, ConcurrentUpdateSolrClientTest, HttpSolrClientConPoolTest, TestCloudSolrClientConnections, GraphTest, JdbcTest, StreamExpressionToExpessionTest, StreamExpressionToExplanationTest, AbsoluteValueEvaluatorTest, AddEvaluatorTest, AppendEvaluatorTest, ArcSineEvaluatorTest, CoalesceEvaluatorTest, CorrelationEvaluatorTest, CosineEvaluatorTest, CubedRootEvaluatorTest, EqualToEvaluatorTest, GreaterThanEqualToEvaluatorTest, GreaterThanEvaluatorTest, HyperbolicSineEvaluatorTest, LengthEvaluatorTest, ModuloEvaluatorTest, NaturalLogEvaluatorTest, OrEvaluatorTest, PowerEvaluatorTest, RawValueEvaluatorTest, RecursiveEvaluatorTest, RegressionEvaluatorTest, ReverseEvaluatorTest, SineEvaluatorTest, SquareRootEvaluatorTest, SubtractEvaluatorTest, UniformDistributionEvaluatorTest, OperationsTest, SchemaTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SchemaTest -Dtests.seed=B01B4EBC0314D822 -Dtests.slow=true -Dtests.locale=mk -Dtests.timezone=Africa/Niamey -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | SchemaTest (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-037: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-037
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming\conf: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming\conf
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets\streaming
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001\configsets
   [junit4]    >    C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\Lucene-Solr-7.2-Windows\solr\build\solr-solrj\test\J1\temp\solr.client.solrj.request.SchemaTest_B01B4EBC0314D822-001\tempDir-001
   [junit4]    > at __randomizedtesting.SeedInfo.seed([B01B4EBC0314D822]:0)
   [junit4]    > at org.apache.lucene.util.IOUtils.rm(IOUtils.java:329)
   [junit4]    > at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [135/146 (1!)] on J1 in 46.85s, 35 tests, 1 error <<< FAILURES!

[...truncated 42300 lines...]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-7.2-Windows (64bit/jdk-9.0.1) - Build # 10 - Still Unstable!

Policeman Jenkins Server-2
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.2-Windows/10/
Java: 64bit/jdk-9.0.1 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

4 tests failed.
FAILED:  org.apache.solr.cloud.TestAuthenticationFramework.testBasics

Error Message:
Error from server at http://127.0.0.1:51019/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason: <pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html>

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:51019/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

        at __randomizedtesting.SeedInfo.seed([DFFA1F853D5F6F13:E222B1A905B13163]:0)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:549)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1012)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
        at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
        at org.apache.solr.cloud.TestAuthenticationFramework.collectionCreateSearchDeleteTwice(TestAuthenticationFramework.java:126)
        at org.apache.solr.cloud.TestAuthenticationFramework.testBasics(TestAuthenticationFramework.java:74)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl